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Abstract 

This report summarizes the data from a comparative study of grades 2 and 5 
mathematics \struction and the use of Developing Mathematical Processes (DMP) 
in IGE and non-IGE settings. These results are part of a five-phase evalua- 
tion of the IGE system of elementary schooling. Use of DMP and reported 
adoption of IGE were not found to be good indicators of instructional 
patterns in mathematics. At both grades, the instructional- emphasis was on 
computation, with insufficient time allocated to other important areas of 
mathematics, in particular problem solving at grade 5. Use of worksheets 
exclusively was found to be ineffective for increasing achievement. Use of 
manipulative materials was very effective for increasing achievement for . 
some objectives. 
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INTRODUCTION TO THE STUDY 

This paper reports the results from one of two comparative studies 
which were a part of Phase IV of the Individually Guided Education (IGE), 
Evaluation Project. Phase IV was cue of five related^phases comprising 

an extensive evaluation of ICE. This report summarJzeL the data from a 

\ . ^ 

comparative study of mathematics instruction and 'the use of Heveloping 
Mathematical Processes (DMP) in ICE and non-IGE settings. These results 

\ . . * 

should be seen* as a part of a larger evaluation of the IGE system of elemen- 
tary schooling. \ 

■ - . - , \ 

An Overview of the Evaluation Project \ 
Through the combined efforts of the Wisconsin Research and Development 
Center for Individualisfed Schooling, the University of Wisconsin IGE - 
Teacher Education Project, the Kettering Foundation ' (I/D/E/A) , and IGE 
coordinators. in 25 states, more than 2,000 elementary schools have a^pted 

■■' ! 

a system dalled Individually Guided Eduv.aLion» 

, The purpose of the IGE Evaluation Project, which began in 1976, was 
twofqld. First, we intended to evaluate IGE to gain a more comprehensive 
view of. the system's operation and effectiveness. Second, we hoped to 
identify which features contribute most^to the success of reading anci 
mathematics instruction as a result of reform-change model, and to use 
the findings to study larger theoretical issues about instructional 
variables, "curriculum planning, school change, etc. ! 



The work of the project was separated into five phases. Phase 1^^^^ 
a large sample Study which provided^basic Information about IGE^s^^^ 
Certain features of IGE schooling were reputedly crucial ^tdlGE success ^ 5 
and the purpose of Phase I was to examine the extent to which thbse^^^^^^v^^^^^^^ 
features had been implemented in IGE schools and to assess the effective-^ 
ness of that implementation. Information was obtained from the staffs 
of ap.proxim.ately 155 IGE schools using self-report surveys and from student 
using standard paper -and -pencil ^instruments. The data were Intended to ; 
-provide-a functiohal-understandlng 'of. IGE features, processes, and out- - 
comes by relating a broad, scope of variables In an Interpretative manner^^^^^ 
(Price, Janicki, & Romberg, 1980)% ''c^ *~ 

Phase II verified and ^xFehded--the"'^lf -report data gathered in ; 
Phase I to include more fully the range of variables that determine " 
the process of schooling (Ironside & Conaway , 1979)^ _ , _ : _ _ 

Phase III focused on the social meaning which emerges as IGE is 
implemented on a day-to-day basis. The problem of understanding the 
impact of educational^ reform can'tTe^ approached by viewing schools as 
social institutions whose characteristics shape and are shaped' by the 

-/ 

behaviors ofrtheir members. This focus allows us to think of a school 
as a complex social arrang6m^t consisting of underlying patterns of ■ 
conduct which channel thought and action^^within that setting (Popkewitz, 
Tabachnick, & Wehlage, in press). 

Phase IV was designed to' examine how effectively the three curricular 
programs (prereading, r easing, ^"and mathematics) developed for IGE meet 
their objectives and to investigate the relationship of^ instructional 
time and means of instruction, to pupil outcomes. 



Finally, the goal of Phase Y is to synthesize the results of Phase I ' 
through, IV and to address the signif icant issues 'in contemporary school ings 
•raised^; by the project as a whole. Thus, each phase, of the evaluation was^ ^ 
designed to complement and strengthen the validity of the data gathered 
by the previous phases; For example, data on meang of instruction, f: ^^ 

gathered by the large-sample study .of Phase I, was examined in somewhat 
greater depth in fewer schools by the Phase II studies. Phase III 's. -^ - 
analysis developed a view of instruction from a d if fer<»nt perspective. > 
Phase IV explores means of instruction in reading and m^th^^ 
Phase V was desigried to integrate and interpret the data from all the ^^^^A^^^^^^^^^^ 
preceding phases into a series of statements of the project's implicat^ions 
for educational issues. - 

' - - ^ c " - Ind ividually Guided rEducat iori - - - - - ^ 7 - 

IGE .is a complex system based dn- theoretic and pragmatic ideas ^bout 

, . ■ . ' ■ . ■ ■ ' ; . • ■■ . : 

schooling, children *s learning, and the prof essional roles of school 

■■; ■ . ' ■ ^ ' ' ■ ■ ■ ■■ ■■ ■.};-■■'.■ ■ ■■ ^ . ■;• ■ ^" ■ : •*■ 

staffs (Klausmeier, 1977). This system has seven components: . 

1. Multiunit organization ^ » , - V 

2. Instructional programming for the individual student 

3. Assessment and evaluation for educational: d^ecision making 

V4 . Curricular and instruct ioual materials and activities f or ; ^ \ 

each child 's instructional program " j - \ ^ ^ - ' . 

.' 5 • ' Home-scl^ol-TCommunity relations program 

6. Facilitative environments for professional growth, and . - ^^^'2.^, 

7. Continuing research and development, for v^^^ 



To relate these seven components," a, descriptive framework was 
developed that considers outcomes of TGE as a function of both instruc- 
tional means and the degree of implementation (Romberg, i976) ; Four 
types of variables were identified to guide the evaluation of IGE: 
pupil and staff outcomes, means of instruction, support systems, and 
pupil and staff background. Figure 1 shows how the four types of 
variables were related. 

1 . Pupil and staff outcomes, and the extent to which these 
outcomes have been attained, should be'%he initial basis of an IGE 
evaluation . Both pupil and staff outcomes are illustrated in Figure 1 > 
as being multivariate and ^multilevel . study, a set of curriculum 

^specif ic pupil achievement scores in reading was used. 

2\ The instructional means of formal schooling must be a second^ __ 
basis for an evaluation of IGE . It has been fashionable in evaluation ^ 
circles to concentrate on ends or outcomes and to ignore-the means by 
which they are reached. Reform movements, such as IGE, invariably 
attack the properties of means. To this extent judging the value of 
the means is as important as assessing outcomes. 

. The means of instruction considered in the evaluation project were 
separated into three sets of activities based upon the operating char- 
acteristics of IGE schools: staff activities of the Instructional 
.Improvement Committee (IIC) and the Instruction and Research Units 
(I & R Units) activities of the staff teacher both in curriculum 
management and pupil interactions, and activities pupils related to 
reading and mathematics instruction. 



3. Both pupil and staff backgrounds are shown..lnfliiencing means of; : 
instruction and Qutcomes , Also, staff background is in turn influenced by 

„trjLin^g_in^^ For pupil backjground, both initial achieve 

ment and demography data were collected. 

4\ The degree and manner in which support systems of IGE have 
been incorporated and developed in a school must be judged . The seven 
components of IGE have evolved as practical ways of supporting new 
instructional methods, which in turn prciduce desired pupil and staff 
outcomes. It can be 'argued that the efficiency of an IGE school de- 
pends upon the components implemented and the manner in* which they are 
operating.'-;;"-' • ' \'\:''- 

'■ The support systems for an. IGE learning^environment were separated 
into four categories as indicated>in Figure 1. The second category, : 
curricular materials compatible with instructional progranrming and - 

"evaluation (IGE Component 4), is shown by^ ident if ying\ the three major 
curricular products dey^elppeAJor. IGE,,. the Wi 

Skill Development (WPRSD) (Otto, 1977) , Developing Mathematical Processes 
(DMP)(Romberg, 1977), and the Pre-Reading Skills Program (PI^S) ; 
(Venezky & Pittelman,- 1977). The functional relationships illustrated 
in Figure 1 convey the following premises: ,(a) the degrere to which 
IGE support systems have -been implemented, together with pupil and 
staff backgrounds, directly influences the mieans of instruction in 
an IGE school; and (b) the mieans of Instruction, along with pupil and 
staff backgrounds, account for piipil and staff outcomes. 

Although much has been x^itten about the conceptual background 
of IGE, no comprehensive picture now shows how IGE has been implemented 



in elementary schools. .Thus, the IGE Evaluation Project was designed 
to gain a more comprehensive view , of the system* s operation and 
effectiveness. The desired outcome is to identify which features . 

contribute most to the success of reading skills and mathematical^ ^ 

■ • ^\ '"^^ \ 

instruction as a result of individualized schooling. x 

• . ♦ •■ ■ • ■ , \ ■. ■• 

Overview of Phase IV \ 

.■ . A ■ ■ • -.- ■ ■ . . 

. ■ ■ . - ■ ■ \- ■ '■ . . . 

The intent of Phase IV was to describe in considerable detail the 

; , ■ - ■ ■ , ^ . ■ . \ ■ : ■ 

actual operating characteristics of a sample of schoolsvwhicti were 

■ . \ \ 

using curriculum materials designed to be compatible withMGE. Phase IV : 

was restricted to the investigation of three groups of variables— pupil 

outcomes, instructional time, and means of instruction — in IGE and 

non-IGE settings in which the Center's curriculum programs as well as 

alternative curriculum materials were being used. Pupil attainment \ 

of program objectives is the main variable. The other two variables, V 

instructional time and means of instruction, are essential in explaining 

and understanding how the programs work^and how objectives are attained. 

These two variables are also important from a practical point of iview 

.because they can be manipulated by teachers. Describing the use cf,: 



each program in terms of allocated time, engaged time, and instructional 
activities provides concrete 'factors that teachers can work with (Webb & 
Romberg, 1979). 

In addition, instructional time was included because of recent 
studies and reviews that stress its. importance and its relationship to • 
pupil outcomes (Harnischf eger & -Wiley,; 1975^ Rosenshine,; 1977 
& Elias, 1976; Fisher et al. , 1975) . As Harnischfeger and Wiley state, - 
"All influences on pupil^achievement must be mediated through a pupil's 



active and passive pursuit" (1975, p. 15). Certainly, there is enough 
evidence to suggest that instructional time is: ah important measure of 
pupil pursuits. Its use as a variable in Phase IV, then, had two 
purposes. First, the amount of time during which students are actively 
engaged in learning when using one of the three programs is a means of 
describing how the pro/irams are being used. The assumption is that the 
programs should maximize student engagement by attending to the indir 
vidualVs needs. Second, Phase IV provided an excellent opportunity 
to study in more detail the relationship of pupil outcomes to instruc- . 
tional time, ^ . 

i ln^surmaryy the primary piirpbgies of Phase IV were: 

1. to determine the degree to which WDRSD and^DMP meet their . 
goals of having students master specified objectives and 
skills. ■ ' 

2. to determine how time is allocated for instruction-in 
implementing WDRSD and DM? ' x 

3. to, relate instructional time to the means of instruction 
and mastery of content for WDRSD and DMP, and 

\ 4. for each curriculum program, WDRSD and DMP, to contrast two 
situations— IGE schools using the program with non-IGE 
schools using the program and IGE schools using the program 
with IGE schools using alternative programs — on the variables 
of pupil outcomes, instructional time, and means of instruc- 
■■ '"tion',; z -'-^ '^'-y: y ^ :■■[': - 

Five studies were conducted as part of Phase IV, three descriptive 

studies and two comparative studies . The descriptive studies were 

small sample studies.'designed to describe how the curriculum programs 

D14P, WDRSD, and PRS were being used in IGE schools. The studies were 

■' ■■ ' ■ ' . . -Ni ■ '•■ " '■• ■ ■■■■■■ ■ • 

. \ . ■ ■ ' - ■ ■ ■ ." ■ ■ ■ - 

conducted during the winter and« spring of 1978 at two. IGE schools 



using DMP (Webb, Nerenz, Romberg, & Stewart, 1980) , two IGE schools 
using \i7DRSD - (Nerenz, Webb, - Romberg, & Stewart, 1980) , and three IGE 
schools using PRS (Stewart, Nerenz, Webb, & Bomberg; 19S0) . The two . 
comparative studies also focused on the use of WDRSD and DMP in IGE 
settings. .This report is on the use of WDRSD. . 
Model for Phase IV 

A structural model for predicting student achievement was developed 
for Phase I (Price, Janicki, Howard, Stewart , Buchanan, & Romberg, 1978) 
from the three premises on which IGE is based: 



1. Certain organizational features make it more likely that 

certain desirable instructional practices will occur. These 
organizational features also make it more likely that the ' 
staff will be satisfied with their jobs, 

2.. The use of certain- curriculum materials and associated 
\ systems- of information collection and record keeping makes 

it more likely that certain desirable instructional practices 
\ ..:will. occur • , V: V. 

3\ Those instructional practices which are deemed desirable in 
-\IGE make high student achievement more likely. They: also 
make it more likely that desirable changes in other student 
characteristics, such as self -perception and locus of control, 

■ wil 1 occur. . • •■« ••; 

Phase IV was designed to provide more detail on the last two premii 
posed in Phase I, with specific attention paid to means of instruction 
and curriculum-relatedvstudent achievement, while providing sufficient 
background information that each school l.n the smaller. ;Phase IV sample 

ight be related on several ^gnificant dimensions to- the findings of 
the larger Phase I sample. Thus, some information was collected on 



five pf the six school-wide variables used in Phase I— General Implementa- 
tion of the Intructional Programming Model (IPM) , Intraorganizational 
Structure (lOS), Procedures Fostering Coordination and Improvement of ^ ^ 
^ the School Program (GOS), Interorganizational Relations (lOR) , and . 

General Staff Background (GSB) . In Phase IV the Program Use variables — 
Curriculum Implementation and Program Customizing— included the kinds 
of information provided in the Phase I curriculum-specific variables. 
More detailed information about classroon^procedures and achievement 
outcomes was also collected in Phase IV. A model depicting the Phase IV 
variables and the anticipated relationships is shown in Figure 2.^^^^^^^ V ^;^^ 
Four groups of variables are shown in Figure 2 — ^school background,: 
curriculum program use^ classroom activities, and pupil outcomes. As ■ : 
stated above, the school variables, which were assessed through strAic- ' " 
tured interviews with school staff , provide a link between the Phase IV 
sample and the larger- Phase I sample. Curriculum program use variables, 
also measured through structured interviews, have a linking function to 
Phase I and provide a descriptive background for the measures of class- 
room procedures. These procedures were, assessed through logs maintained 
by teachers for selected students and through observations in the class- 
rooms; means of instruction and the use of instructional time are detailed 

measures of how programs are used in classrooms and related directly to 
pupil attainment of objectives. Pupil outcomes were specif ied- in terms 
of specified objectives of DMP and were assessed through achievement 
monitoring procedures. - 
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Figure 2. 'Phase IV model of anticipated .relationships bcaveon.variablcs---(Romberg, 

Webb, Stewart, i Nerenz, 1980, p, 24), ; ' ■ \ \. " , • 
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The DMP Program ^ . 

In order to better understand the data ga:theririg procedures used In 
this study^ a brief introduction to Developing Mathematical Processes" (DMP) 
(Romberg, Harvey, Moser, & Montgomery, 1974, 75, 76) may be helpful. DKP 
is a total program of elementary mathematics for grades k--6 developed- ! 
to be compatible with the IGE instructional programming model. It is orga- 
nized in the following way. Activities designed to promo ttf^ attainment of 
closely related objectives have been clustered 'to form 90 topics. These 
topics have been grouped, into units for purposes of organizing materials and 
facilitating continuous progress of children. To provide^' for ease in order- 
ing and storing materials, the units have been divided into levels that ap- 
proximate one school year of study. Tab3-e 3 indicates the organization of 
the materials. The organization of Level 1 has been expanded to indicate' 
the manner in which topics and activities are labeled for reference purposes 

Table 1 

Organization of DMP by Unit, Level, Topics, and Activities 



UNIT 



PRIMARY 



! UNIT 



LOWER 
INTERMEDIATE 
UNIT 



LEVEL 

(level K 
Level 1 
Level 2 

Ueyet 3 
Level 4 



UPPER ~~| [Level 5 
INTERMEDIATE 
UNIT _J Level 6 



TOPICS 

Topic 15 
Topic 16 . 
Toplc17 

Topic 26 
Topic 27 



ACTIVITIES 



♦I Activity 16A 
Activity 16B 



Activity 16H 



The components of DMP are resource manuals, teacher 's guides fot^ each topicy ^, 
student booklets^ and guides, printed and physical material kits, a preassess?r. : 
ment patkage, topic inventories, and pupil ^ perf ormance riecords. -/J^r 

DMP approaches mathematics through the measurement of attributes. The ' 
major content areas are problem solving, place value, attributes, measure^. ' 
ment, addition -and subtraction, multiplication and division, fractions, V; 
geometry, and statistics. An emphasis is placed on exploring relationships 
between objects v^lng processes .such as describing, classifying, ordering, ,• 
equalizing, J oi < ;separating, grouping, and partitioning. * [^. ■r 

As. shown in i; ce 3, a sequence d£ activities is. specified within ^^^^^^v ; 
each topic. Alternate activities are included for students who need more work^ 

on an objective or provide a variation, in instruction or challenging problems^ 

' ' ■ ■ ' ' ■ ■ " • -.'*■,,'" 

The activities are keye'd to objectives. The topic Inventories are used t^^^ 

assess mastery of the objectives for each topic. Instructional activities 

include experiments, use of manipulatives, learning stations, games, stories, 

discussions, worksheets^ and contests. 
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Design of the IGE/DMP Comparative Study 

^ ' Details of this study of mathematics- instruction in IGE and noii-IGE 
schools are described in this chapter. Included are the- research ques- 

. tions to be examined; the basic design pf the studyj including the . 

,v sampling procedure used; how the data were collected, aggregated, and . 
scaled; and the analysis plan. 

Research Questions 

ri";; As d£sdii3sed Chapter I, this study examined three primary re- - 
search: questions. ^ - 

1. What are the effects on mathematics ^Instruction of using the 
DMP mathematics prpgram in, an IGE and a non-IGE school environment? 

To answer this question, data were gathered from a sample of IGE 
schools using DMP and a similar sample of non-IGE schools using the same 
program. y 

2i What are the effects^on mathematics Instruction of using DMP 
and using other mathematics programs in the IGE school environment? 

. ' . ' / / > , - 

, \ To answer this question, data from the sample of IGE schools'^ usiiig 

- 0 . / 

DMP used to answer question 1 - and data f rom a samble of IGE schools 
using'^pther-mathematics programs were gathered. / : 

3 . ; What .are the relationships between the variables presented in' V 
figure 2? . ^ ^ " ^ L 



To answer this question, da^a from the total sample of schools 
used to examine the first two qiiiest ions was utilized. The diagram 
in Figure 2 could be considere^ a structural design, path diagram, 
or causal model. Ideally, if each of the variables specified 
in the diagram was scaled, a/ set of structural equations corresponding 
to the model could be written. Then these ecjuations could bie statis- 
tically examined for their agreemrat with the data collected in the 
Phase IV study. Within the limits ixaposed by measurement error in the 
procedures used to collect the data, this approach would: test the ; 
theoretical model. Unfortunately , although this structural analysis/ - 
was planned, it could not be carried out. The, small ntmber of caseS;- - 
coupled with difficulty in scaling some variables (leading to several 
separate variables^ — in particular, a larger set of student achievement 
variables)" and disagreement on the existence (or non-existence) of some 
relationships (paths) made such an analysis unfeasible.: Instead a two. 
stage multiple regression analysis was carried out. ;For the first 
stage, student engaged times on content objectives were used as the 
dependent variables and the classroom activities, curriculum, and 
school variables were entered as independent variables. At the 
second stage, student achievement scores were used as; the dependent 
variables and the student pursuit variables were then added to the - 
other variables . 

Operationally, there were three problems associated with answering 
these questions.^ First, reasonable samples of schools had to be 
recruited for the study so that appropriate comparisons could be ; 



made. . The sampling plan Is described later in this chapter. Second, ;. ; 
since the schools differed only in "labels" for their instructional : 
environment (IGE or not) or their mathematics program CDMP or not) , arid ^^^^ ^ 
since we knew^chools varied in their degree of commitment imd manner ^^^^ ^ 
of use with regard to both IGE and DMP, some data were needed to:^j :: 
demonstrate that the labels reflected actual operational differences. 
Third, we needed to aggregate and scale the variables' associated with 
mathematics instruction. Details of how this was done follows in this 
chapter. ' 

JThe Basic Desi^ of Mathematics Comparative Study 

Data were gathered for this . Comparative Study from October until 
May during the 1978-79 school year. As described , three types of schools 
were included in the study; 

1. IGE schools using DM? 

2. Non-IGE schools using DMP 

3. IGE schools not using DMP \ ' / 
Data were collected only from students in Grades 2 and 5 and their teachers 
in those schools. Data were collected by four means; tests on general 
objectives of DMP, observations of specific students during the mathematics 

.Instructional period, teacher logs for mathematics instruction of specif ic;: 

students , and questionnaires which served as the basis for structured j^^^^^^^^^^^^^^:; 

■■ , i';';. - • ■ ' y'C'.' : ^^^•/'■■."^'''- 

interYiews with school staff. J : M ^ \' : 

Sample > Three DMP triads of schools were identified to participate^ 

^ In this study. Each triad was to have one school of each of the three / 

typeg^v Schools within each triad were matched according to location, - , ^ 



socio-economic level, composition of student body, size, and., for the 
IGE schools, "IGE-ness." The same demographic categories used in 
Phase I (Price, et al., 1978) were used to classify the communities 
in which the schools were located: 

1. Extreme rural — -coiranunity with' a population under 3,500 where 
most of the residents are farmers or farm workers 
. 2. Small place — conmiunity with a population of less than 125,000 

3. Medium city—city with population between 25,000 and 200,000 

4. Main big city — community within the city limits, of a city 
population over 200,000 and not Included in the high or low 
metro groups 

5. High metro— area ^in city with a population greater than 150,000 
where a high proportion of the residents are in professional 

or managerial positions v 

6. Low inetro-^-area in city with a population greater than 150,000 
where a high proportion of the residents are on welfare "or not 
regula*rly employed 

7. Urban fringe— i^community within the metropolitan area of a city 
-with a population greater than 200,000 outside the city limits 

and thus not in the high or low metro groups 
The three triads of schools in the DMP study represented extreme rural and 
small place, medium city, and urban fringe. One medium city IGE school * 
using DMF withdrew from the study just prior to the beginning of the 
data collection. Thus, the medium city group was reduced to two schools jv^ 
an IGE school not using DMP and a non-IGE school using DMP, bringing the ' 
number of schools in this study to eight, ^ \ / 
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Data cbllee^tloh * Four procedures were used to collect data from, 
second- and fifth-grade pupils arid teachers in the eight schools. 

Pupil outcomes were measured using an achievement monitoring 



procedure with item sampling. The DMP program contains topics of 
instruction related on the IGE instructional programming model (IPM). 
Oice a pupil has mastered the objectives of a topic, he or she is to be 
regrouped with the other pupils with similar needs and given instruction 
on a new topic. The instructional sequence of topics ; should vary from' 

pupil to pupil. Because of this variation in the instruction 

which pupils receive, an achievement monitoring procedure with tests 
administered at eight points during the school year was chosen to provide 
information on the attainment of objectives. Such a procedure is more 
sensitive to the individualization of the programs than other designs, 
"such as pre- and posttesting. - - 

The tests used to the IGE Descriptive Studies (Webb & Romberg, 1979) 
vere refined for use in the Comparative Studies. The tests we re compiled 
by identifying 12 DMP objectives in Grade 2 and 14 DMP objectives for Grade 
5, One to four items for each of the DMP objectives were then prepared to 
form an item pool for each grade level,. Items from each pool were dis- 
tributed among four forms using an item sampling technique. All achievement 
monitoring test items were constructed in a multiple-choice format and 
\ used terminolTogy which would Ije understood by pupils -in programs other ^ 
than the curriculum under consideration* . 

The achievement monitoring tests were administered .eight times during 
the school year. The pupils at each .grade level'were divided at random 
into four groups and the four test forms at each level .were: rotated -^ong;.;;^^^ 
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the groups so that each group was given a different form of the test 
for any two consecutive administrations and, over the school year, each 
student took each form twice. The maximum time for any one testing for 
a student was 50 minutes. 

A second testing procedure was used to nieasure achievement on three 
specific math objectives at each of the two -grade levels at the eight 
schools participating in the mathematics study. Domain-referenced tests 
were administered three times— at test time 1 (October), at test time 4 
(January), and at test time 8 (May). This procedure was used in order to 
test key objectives in more detail and to provide a measure of pupil out- 
comes on the general concepts and ideas associated with the objective 
domain as well as specific skills needed to perform the individual items. 
For example, for the Grade 2 objective of counting objects in sets from 
0-99, the analysis of the' domain-referenced tests- provided, measures of, 
the ability of the group of pupils to count the objects as well as the 
pupils' specific problems in counting objects grouped in different ways 
(e.g., by fives, sixes, and tens). 

For each of the three test times the domain-referenced tests were 
administered, a set of ten items was randomly -chosen from the specif ied 
domain, of items for each of the three objective's, for the grade level. All 
items were open ended and required the pupils to supply the answer in 
order to minimize guessing. . The Harris-Pearlman (1978) procedure was used 
to separate the item difficulty Into ;two factors , one rep^ 
domain difficulty and t^ other representing difficu 

item. Also, since all students took the isama tests, the domain-refer enced 
tests can be used t(Q_con?)are the representativeness of the outcomes of the 



target students to the group from which they were, selected. The testing 
time for the domain-referenced tests was approximately 40 minutes. How- 
ever, results from these domain-referenced tests are not included in this 

\ • . 

.analysis. ^ \ 

\ ■ ... 

Observations were carried out using the same system as in the \ 
Phase IV Descriptive Study (Webb & Romberg, 1979). Initially , six \ 
target students were randomly identified in the unit or class. The 
target students changed over the year, since in some IGE situations studentc 
are regrouped periodically, making it physically impossible to observe the 
same six students. The target students were. observed in ^sequence using 
a time sampling procedure. The first student was observed for a moment 
and his or her activity was coded. Then the next target student was 6b- . 
served for a moment and his or her activity coded. The procedure contihued 
until all six target students had been observed, taking approximately 3 
minutes. Thirty seconds were then taken, to record\the maj or role of the 
teacher (s) and general activites occurring in the classroom. This cycle 
was repeated, observing each target student in sequence and recordin 
general comments , during the time allocated for work on the curriculum 
program. 

Seven major categories of data were coded: 

JL. General content — time devoted to other than the curricular ^ . 

program being observed ; • ^ ;^ y 

; 2. Specific contents-math objective or reading skill 

3 • Pace— whether or hot the student is working at his or her 

9wn pace 

4. Grouping— size of group of which the student is a member 
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5, Materials-^the materials being used by the student 

6, Learner moves — student engagement or non-engagement 

\ 

7, Interaction — persons with whom the student is interacting 
and the direction and focus of that interaction 

The event occurring at that momept the target student was observed 
was characterized by checking subcategories under each of these main 
categories. This observation system was used to provide measures of the 
amount of time spent in general content areas such as waiting, transition, 
and management and, for specific content areas in mathematics j measures of 
the amount of time spent by students with different types of engagement. 

The observers were trained to use the observation system In a 
four-day training workshop held in Madison in October 1978. The first V 
day of the workshop was spent reviewing the materials and procedures 
used in each of the programs and expla^^i^^ 

the observers spent three days at a school doing observations and dis- 
cussing the coding procedures. Percentage agreement on individual events 
and intercoder reliabilities on sums over events were calculated to 
assess the level of proficiency the observers had attained in using the 
observation procedures (Webb , 1979). In addition, ;a sample of schools ; 
was visited during the year to check the percentage agreement and 
intercode reliability. The observers returned for a two-day retraining 
session in February 1979; most of which involved observations in^^ " - 
schools to check on the intercoder reliabilities. 

Teacher logs were kept by the teacher who was directly responsibly 
for the mathematics instruction of the students in the target population; 
These logs were kept daily for six to e^ght students, including those . 



• . • ■ ; -23 : V 

Students being observed, in order to obtain a measure of the total 
time allocated to instruction on/ specif ic objectives over. the inves- 
tigation period. On the logs teachers recorded the amount of 
instructional time allocated to specific mathematics objectives, the * 
group size, and type of materials used during instructicn. 

Interviews were conducted in each school by the observer for ' 
that school with members' of the Grade 2 and Grade 5 instructional staff 
and with the principal. Background inforraatioi about the school, the 
staff, and use of the mathematics curriculum products was obtained from 
these interviews. The questionnaires used as the basis for ;the inter- 
views were developed from two sources: the Phase I survey Instruments 
and the curriculum developers* questionnaires about product use. 

Instructional staff provided information about their, own teaching 

, ■ ' ' _ \ / 

experience, how the curriculum product was used, and how the overall 

instructional progr^ was planned and carried out. Each principal de- 
scribed the school* s organization, its relationship to other educational 
agencies, and some procedural. aspects of the school's ongoing operation. 
Data Aggregation and Scaling "* - - _ 

LiteraSy^il lions of separate pieces of information were gathered 
about ma thematic>v instruct ion in the , schools in this study. The aggregatiph 
of this i^iass of dataxintp scaled variables was no easy task. The model/ 
given in Figure 2 -((^lap^ 

(School, curriculum, classroom activities , student pursuit s, and pup 11;^ 
performance) . Then within ea^h- category ,one; or more general variables ; 
was specified (13 in all). However, the actual number of variables int:o Vv 
which- the^ raw data was aggregated was considerably more than 13 for 
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four reasons. First, all classroom and performance data had to be . 
aggregated separately for Grades 2 and 5 in each school. Second, for 
some general variables (like means of instruction), specific sub- 
categories (like pacing, grouping, materials, and interactions) had to 
be considered as separate variables. Third, student achievement in 
mathematics was considered to be mult idlmensicnal. Pupil performance 
on specified program objectives was gathered, which led to aggregation 
of performance data into 23 general content objectives for mathematics 
(11 at Grade 2 and 12 at Grade 5). However, tlie related time variables . 
(allocated time, engaged time, and non-*engaged time) were also ag- 
gregated with respect to the same categories. Fourth, since data 
were gathered at several points in time, all of the data could also 
be aggregated in terms of when it was gathered. 

The content aggregation-'f or mathematics instruction was used 
with the teacher logs, classroom observations, and achievement monitor- 
ing tests./ The data were grouped for analysis at three progressively 
more . specif ic levels , the most inclusive beiiig the "content area followed 
by the "general objective'V and the "specific objective." f 
y'^. For purposes of this, study we organized the mathematical objectives 
into eight content areas: Place Value and Numeration, Operations (whole , 
numbers). Fractions, Decimal Fractions, Measurement, Problem Solving ^ 
Geometry , and Miscellaneous. Within each of these content areas at each 
grade, frc«i one to three general objectives were developed for the 
present study. The general objectives were based oh the specific ob-^;^^^::' 
jectives of D!fP. It should be noted that while the same content areas , - 
are used for both grades the general and specific objectives differ. 
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Tlie aggregations for Grades 2 and 5 are as follows: (See Nerenz & 
Webb, 1980a, for details.) 

* . ■ ■ ' ' 

Grade 2— place value and numeration . The content area Includes 

three general objectives: Writing Numbers, Inequalities , and Other 
Place Value or Numeration. The Writing Numbers objective requires 
students to count the number of objects in a set and then write or 
recognize the appropriate numeral. Specifically, it includes compact, 
grouping, and expanded notations. The Inequalities objective focuses 
on ordering whole numbers, usually in sets of three, using appropriate 
symbols. Other Place Value or Numeration objectives include any other 
objectives asking students to identify and specify place values, count, / 
or write the numerical value of sets of objectives or measurements. 

Grade 2*-- Operations. The operations content area focuses on the 
manipulation of whole numbers using addition/Subtraction or multiplication. 
For each of these two general objectives, children were to solve open 
sentences or to compute sumsj differences, or products given two or 
more numbers to be added, subtracted, or multiplied : The numbers used , 
in all computations ranged for 0 to 1001 

Grade 2^ Fractions . This content area and its ;general objective 
require the student to understand the basic concept of a fraction. 
Specifically, children are to identify a fractional: part of a. set or 
area and to use fractions in other eiementary^context - a 

Grade 2rr- Decimal Fractions . This general objective includes all 
objectives that involve decimal fractions. The general objective is ; : 
not subdivided into specific objective levels since decimals are generally 
not taught at Grade 2. 
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Grade 2— Measurement > Measurement Includes objectives that 

Involve the assigning of a standard measure to a physical object or 

/■■.,. 

picture. The two dimensions of measurement whicli are included in this 
area are length and capacity. / 

Grade 2 Problem Solving , This content area includes two ob- 
jectives — Word Problems and Applications — in whicli gtudents were asked 
to find the solution to a verbal or pictorial problem. Word problems 
were stated in two or three units and could be solved by writing and 
then solving a mathematical sentence. Word problems were mainly re- 
stricted to ^one-step problems requiring the student to add or subtract 
two numbers. Unlike word problems, applications problems require 
the student to apply and combine different computing skills and more than 
one operation and step is generally necessary. 

Grade 2-- Qeometry . Objectives concerning geometric shapes, movement 
or direction on a grid, and transformation 'of figures are' included in this 
general objective. 

Grade 2— Miscellaneous , This general objective includes any ob^ 
jective that cannot be classified undergone of the other general ob- 
jectives, such as time and money. 

Grade 5"^ Place 'V^lue and Numeration . This content area includes 
all objectives related to place value , counting with whole numbers, 
using different notational forms (compact , grouping , and expanded notation) , 
and number theory (primes, odd, even, lowest conmion denominator) . V 

Grade 5-^ Operations . The Operations content area focuses on three 
general objectives: Addition/subtraction, Multiplication, and Division. 
The objectives included in this content area requirie students to apply L ; 



computational algorithms and recall basic facts. The objectives in- • 

■■ ■ \ 

elude finding sums with numbers from 0-99,999, finding the difference 
of 3- to 5-digit numbers, finding products up to 999,999, and dividing \ 
S-digit numbers by 2-digit numbers. ^ 

G rade 5— Fractions . The Fractions content area includes objectives 
pertaining to fractions in a ratio form (^) . The content area is 
divided into two general objectives. The Concept area includes general 
understanding and representation of equivalent forms, and ordering of 
fractions. The Computes general objective includes solving addition, 

y • . ■ 

subtraction, and multiplication sentences involving fractions. 

Grade 5— Decimal Fractions . The" Decimal Fractions contisnt area 
involves fractious in decimal form. The two general objectives focus 
on concepts and computations with decimal fractioi^s. The .Concept 
general objective includes finding an equivalent decimal form for common 
fractions. The Computes general objective includes finding the product 
of a whole number with a decimal, f inding a siun of two or more' decimal 
numbers, and finding a difference using two decimal numbers. . 

Grade 5-^ Measurement , All objectives dealing with measurement 
(lengths » areas, and volumes) are included under fche general objective. 

Grade 5-^ Problem Solving . The Problem Solving content area in- 
eludes objectives that are divided into two general areas. 
Problems require students to solve vproblems that are; generally s tat ed^^^ ^ 
in two or three lines arid whose .isolution can be found by writing and 
then solving a sentence.^ Applications require student apply or 
combine different computing skills in solving vprobleias and -usually ^ 
require more than one ^ operation or step. ^^^^^^'^ : . ... 



.Grade 5— Geometry , JlII objectives relating to' geometry are , : 
classified under this content area, ^including objectiveg regarding ; . 
geometric shapes, movement or direction oii a-^ grid; or, the; tran 
of figures. ^ . ' ' ^ 



Grade 5— Miscellaneous , The miscellaneous content' area .incl^^ 
any objective that cannot be classified under one of '^.the. other .content "-j^;. ^'^^ 
areas. The area is subdivided at the specif ic objective level.. in tor%^ - 
"two classes of objectives. Other Computations include>obj ectiVes where 
students are asked to compute averages or percentages- and vto use^^^^^T^^ 



cesses which are not directl3^^ related to the objectives under the^^(^ 
content area^ Other Miscellaneous includes;;such objectives as numeration 
systems, number theory, oi; graphs and tables. . . . 

Both log allocated time and observed - times wereT aggregated^^^v^^^;^^ :^^^^ 
separately for each grade f or 11 and ;12 : general ;obj ectivesv; and - then, 
reaggregated ^according to the eight content areas. Achievement data, 
however , were gathered only on seven of the conteptvareas atr;^^^e^ 
(see Webb & Nerenz, 1980b) . y At Grade 2; objectives; for. decimal^^^^^^^^^^ 
were not measured, and at Grade 5, objectives :f or place value and 
numeration were not measured. These, differences reflect the change inr^^ 7^^^^^ 
emphasis in mathematics between Grades 2 -and 5. ^^^^^^ - 

The potential number of variables is dramatically Increased be- 
cause of the repeated measures design of the study. ^ A.11 pupil performance 
data were gathered eight times during tfie year, teacher logs were kept, : 
• and classroom observations- occurred in all the periods between test times , 
(see Figure 4). Thus eight 'different sits of achievemeait data and seven ^ 



different sets of , observational data were available for. analysis. However 



..for several reasons, "it was decided not .to analyze the data at this levei\ 
of detail. These reasons included lack of resources* lack of support for- 
distinctions between types %f schools (see Chat) tet I'llV^'^'d a failure . 'J 
to discern meaningful patterns in the achievement data' (Webh Nereriz ,\ w i ! j 
1980b).,, For this report, only achievement datavfrom , Test . Time 8; (adjusted 
for Test Time 1 differences) are presented.' ' 
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Test Test Test Test Test Test Test Test 
1 2 3 4 5 6 7 8 

Figure.,4. Observation periods and test times for the study. 



All the teacher log and classroom observation dat^a were aggregatedv^v- 
over the seven observation periods into school year totals; Admittedly 
this aggregation- obscures the f luctuations in content emphasis that ' 
occur during a year. However, the patterns of emphasis (allocated times 
, to various general content objectives) appear not to be associated with • 
IGE or use of DMP (Nerenz & Webb,' 1980b). 

The actual variables used in this study -are as follows: 
Student Achievement . Residualized mean gain scores (Test 8 ad- ■ - 
justed for differences on Test 1) were calculated for 14 variables at ^ 
Grade 2 and 16 variables at^ Grade 5 (see Table 2) w This set ^ot scores K 
for each school appears in Appendix A. ' > 

• Student Pursuits . Time was used as the unit f or ■describing student^ ■ 
pursuits The observed number of minutes coded f or the - sample of 'childreh^ 
was used as the measure of four categories of variables at each grade-. ^' 
level: non-applied time ^ available time, engaged. time, and non-engaged ^ 
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Table .2 



Student Achievement 



^ General Obj ect ivie^^ ^ ; 



t: Variables, for; the IGE/DMP Comparative Study (r^^^^^^ 



Grade ^Z'J^j^, . . _ 



01 Writing .Numbers 

02 . Inequalities 

03 Other jpiace Value , 

or Numeration ; " 
Place Value and Numeration. 

04 Add it ion /Subtraction 
05: "Multiplication 

06 Division 

Opeifations (Whole Numbers) 

07^ Concept: 

08 Fractions Computes 
Fractions 

09 Decimal Concept » 

10 Decimal' Computes 
Decimal Fractions 

11 Measurement 

12 Word Problems 

13 Applications 
Problem Solving 

14 Geometry 

15 Miscellaneous 



■■/■_., ■ 

'■ '.'V 
01+02+03''): 

: 04+05 
07 ■ 




y 

../,'.■■,• 

12+13 



/ 

04+05+06; 
V 07+08 V 

^.:-y'tQ9+lp■^- 

/■■:•■■:'■ 

■ ■ ' ;/ ■ 

12+13 ^ 
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Non-applied time Is that time within the designated skills period 
speiit in activities which are unrelated \ to reading ^skills or to mathiw 
This includes time spent in transition, waiting, management, break,, orr, 
other academic pv nonacademic content , area These s ix* typesi of non-app lied 
time were aggregated into three subvariablgs.: ; undirected tto 
waiting) , t supervisjBd time (management , break) , and ; other content (other c 
academic or nonacademic content) for each grade level. 

Available time equals the total amount of observed timfe less the^^^^^^^v; 
non-applied time and thus' is that portion of the instructional period : ' . 
which remains once undirected, supervised, and other content tim6 have • 
been subtracted. As indicated by the variable name j it is the time^^ : 
which is actually available for mathematics instruction. The total^^.^^^^^^, , : 
minutes and percentages of available time were reported in terms of the: 
15 content variables at each grade level. 

Engajged time is that portion of the instructional period during 
which students are actively involved in learning the particular v content 
When summed, engaged time: and its coir5)lement, non -engaged :time, equal : 
available time. Total minutes and percentage of engagement or non- 
engagement are reported as the aggregated variables for each of the ^^^^^ : 
content categories for mathematics at each grade level; In creating : 
these variables , the three types of coded engaged student behavior 
(engaged-writing V engaged-oral, engaged-covert) were :summed. Similarly^^^^^ V^^^^ 
total non-engagement was created by summing the three categories of 
non-engaged behavior (nori ^engaged writing, non -engaged interim, non- 
engaged off-task). 

' Classroom activities . Time was also used as the unit ; for describing-^^^ 



classroom activities^ There are two categories of ■ variables v allocated^^^^^^:^-^^^^^ 
time and means of instruction, and both were measured using teacHer log . . V 

data and observational dait a; ' , , " " ' ' .r"^' 

^ ' I . . ' , - - ^ \ f \ t'-'^ 

' Allocated time is the amount 'of time' in minutes which is designated/;.^ 

for instruction in mathematics; it represents the total amount of planned 

instruction for the 25 weeks. In each school, teachers recorded this 

'information in logs • The time allocated by these'- logs was aggregated^^'^^^^i^^^^^^^^ 

into the content categories f or mathematics at each- grade x leve 1 . A 

proportion of all allocated time was obsierved in each school . These ^-^^v^^^^ V.v^^^ 

observations were used to check the validity of the teacher 's estimates 

of allocated time. _ 

Means of instruction includes the teaching procedures and materials 

used to Implement a curriculiwi program and convey, subject matter to the f^: ^ 

learner; -Four types of Information wfere coded for each of; the content ^^^^^^^^^^^^^^^ 

categories at each grade. 

Pacing included either self -paced activities or other-paced actiyitiej 

Pacing correlated so highly with Grouping in the Descriptive Study no '^y':'''-:c'^ 

separate data for Pacing was tabulated for this study (Nerenz, Webb <^ 

^Romberg/& Stewart, 1980). 

: Grouping included one of three group sizes .on the teacher logs: ' 

individual, small group (8 or fewer), and large group. On the obser-y 

vation forms , data on student groupings were' coded into one of four 

categories: individual, pair, small group (fewer than 8) , and large group •■ 

However, because pair and small group activities were rarely observed, 

these two categories were ccniblned, resulting in the same three grouping:'^^^^ 

categories that were used von the teacher logs . 
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* Materials used during Instruction were recorded on the teacher logs^^^^'^^^^^^: ;: 

^rid the^ oH&ervatlOTs; On the teacher logsv four -types of ^m^ 
considered: DMP, text or other vcurrlculijm series, teachefHOnade, and ^ 
Other/ Seven categories of materials were considered on the obseryatlpn^^^^^^^i^^^^^^^^^^^^ 
forms : paper/pencil, manipulative , game, audlovlsuali ; m 
other, and can't tell, ^ Because very little time wasvobserved In the 
audiovisual, other, and can't tell categories , these .Were aggregated Into 
a single subvarlable. Manlpulat Ives and games were /also merged to form 
a single subvarlable. 

Interactions between the target student and the teacher, other 
adults, and other students were recorded by the observer. These categories 
were combined Into two: student to teacher (or other adult) and teacher-^^ . 
(or other adult) to student. \ . ^ 

Curriculum . Two variables were^created to characterize the use of 
the mathemat^ics program, DMP, In schools : curriculum Implementation and, 
program customizing. Both are school variables estimated for each grade :. 
level. Data came from Interviews with school staffs, 

\ Cur r Iculum Imp lemen t at ion is a measure of the extent to whl<^|||fD 
is used. To develop a curriculum implementation scale, points were given • 
for use of DMP as the main program, the variety tof materials which were ^^v^ 
used and the use of pupil performance cards. To derive a total score for- 
each grade level , scores f or each teacher were summed and an average found ,; 
(see Nerenz, Stewart, & Webb^ 1980 for details). . ^ 

" ' Program Customizing- is a measu 
specific needs of individual students. Three aspects of customization 
were: measured : adaptations to children' s instructional needs^ provision^.3^ 
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for review and reinforcement, and- teacher development of materials 
Adaptations were defined as changes, additions, and^^iet'ions in the— r 
curriculum program, and two facets 'of program adaptations wer6 cons idered^^^^^^^^^^^^^ 
The first is whether tlie program - is adapted to^m 

The second is whether the existence of multiple Instructional programs 
leads to duplication of instruction. Points obtained for these two ire- ' ; 
sponses were summed for each teacher . Provisions f or review > and re inf orce-^-;; 
ment were considered to be an essential aspect of program ■ use /^ -Poin 
were assigned if provisions for reviewing obj ectives werev reported .-Also , 
teacher, development of materials was assigned one; point if a: teacher ; ;^ '^^AV# 
indicated preparation of special materials. . \ ' 

Subscores for • customiaing were summed for each teacher and averagesy^^^^^^^^^^^ 
were calculated for each grade level in each school. Possible values:i^^^^:fe^ 
ranged from ^-3 to 9 (Nerenz, Stewart > &%bb, 1980). . ' . 

School . As described- in the IGE Evaluation Project ,: it ^- w^ 
that certain organizational features would' make it more -likely that ! certain ■ 
desirable instructional practices will occur (Romberg, 1976) .^Data related^ 
to this premise were organized into five variables 

Relations , Procedures Fostering Coordination and Improvement of the School 
Program, Intraorganizational Structure, General Implementation of the 
Instructional Programming Model, and Teacher Experiences. These describe 
in detail the organizational ^structure-andi^ the school. : . 



A sixth variable. Demographic Background, was also included as' a description 
for each school. 

Interorganizational Relations (IOR) ;.^This variable is a measure^^^^^^^^^^^^ 
of school affiliations and staff activities : which^^inyolve persons and 



organizations outside of the school . Subscores were developed for ^ 

(a) school interactions, with parents, (b) district support of the 
curriculum program, and (c) .district -wide meetings about program issues ^ \ 
and, for IGE schools only, membership in a regional group of IGE schools / ; 
Teacher scores were summed and averaged for a school score ranging from 

0-6 points. Data on district support of the school's mathematics or ' 
reading curriculum program were obtained from the priijicipal's questionnaire 
with a maximum of 3 points possible . All principals reported the frequency; 
of district-wide meetings focused on curricular issues; points were 
allocated differently for IGE and non-IGE schools, although each group. ^^^^^^^^ 
could receive a possible total of 3 points; An^lOR total score is a.^^^^^^^^^^- ^ 
sum of the thjee subscores and * has a possible range of from 0 to 12 points 
(Nerenz, Webb, & Stewart, 1980). 

Procedures Fostering Coordination and Improvement of the School 
Program (G OS) . , This variable is a measure of the schoolrwide procedures 
arid practices which are designed to promote continuity and refinement of : 
the overall school program. Scores for (a) release time for staff planning 

(b) orientation programs for new teachers, and (c) inservice procedures 
were developed. A GOS total scale was derived by summing the points forv . 
these three elements (Nerenz, Webb, & Stewart, 1980). v 

Intraorganizational Structure (lOS) . This variable is a measure - t;. - 

of the school * s internal organization and the mechanics of its f unctioning . 

Scores indicate the extent to which students and, staff are organized into „ 

\ ^^^^^ - 

multiaged instructional units and the amount of time is. available for 

regular meetings of the school's -governing body .^^^^^^ U^^ 

how their school organization was best described :^"^ltigrade units, 



36 



self-contained classrooms with some team teaching and coordination 
within grade levels , or self-contained classroom^.^^^^^^1^ ^ 
also provided by the principal on a chart of .school organization.' All ^'^^^[^ 
points for reports of multigirade tmlts were developed, from, that^c^hart. 
Qni the organization chart, principalis reported grade range of units ot^':^,^^-^\ 
teams, number of pupils per unit, and number of units holding regular ^ ^ 
weekly planning meetings, ' ^ > 

An lOS total score is the sum of the -school governance and schoor^^^^^ 
organization subscoring yielding a school--wideiIOS -score of Aip^ t 
points (Nerenz, Webb & Stewart, 1980). ' \: 

General Implementation of the Instructional Programming Model (IBM^W^^ 
This IPM is a measure of i the extent to which the : school is organized ^a^ 
the following steps of the IGE model for Instructional •Prdgramminjgvfor;^^ 
the Individual Student: ' \ ' - - , / . i 

1. setting school^-rwide Instructional objectives \. 

2 • selecting a subset of S obj ect ives f or ■ childfen\in ^each^^^ 

3. keeping and using records^ of assessment results^^^^^^^^^^^^^"^^^^^^^^^ v r:.:^^:'-^: 

4. planning for instruction, including short-term grouping procedures ; 

5 . provid ing instruction , ' including variety in mat etlals and in ; 
- ' group size ^ . ^ . \^ 

6. assessing mastery of individual obj ectlves ^ -v 

7. planning and evajuat ing the cveralllnstructlcnal program ^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^ 
Scores were developed by summing seven subscores, one-^f or eac^ 

the seven stepsv yielding a maximum of 120 point s-(^ & Stewartyt 

1980). . ' . J- rrT? 

Teacher Experlencfe (TE)v ^Thls variable: is a.meaaure bt^staff4tea:chers 



overall experience in education as well as their experience- 
schools^ Scale values were assumed for each teacher Results were 
then averaged yielding a school score ranging ' from 1 to 5 points (Nereriai^^ 
Webb, & Stewart, 1980). ; . ; : 

Demographic Background (DB) ; This variable provides! a descriptid^v^^^^^^^^^^^ 
of the student population of the school. This scale wa/ derived from 
the National Assessment of Educat ional Progress (NAEP) which used seven 
categories of size and type of community in reporting results. These^^^^^ v 

• • ' ' ^ ! , 

seven categories (see sampling section earlier) werei used tp assess DB ; 
in Phase I of-^'the IGE study and in Phase IV (Nerenz ,] Webb, & Stewart, 1980);. 

T he Analysis Plan v; ■• 

Insight of the research questions posed at the start of this 
chapter and of the operationai probifims faced in doing the study, a /five- 
step analysis plan was followed: v. . - , 

st ep 1^-School Descriptions > . Differences in the operating character- 
istics among the three types of schools (IGE DMP, non-IGE DMP, and- y / 
IGE-non-DMP) were anticipated to predict differences in the way instruction« 
time was used and in \turn predict student performance on specific mathemati< 
objectives. At this initial step, the schools were to be described in ^ ; 
terms of the school background and program use variables in order to ; ; 
demonstrate that the labeled- differences (IGE or not , DMP or not) v^re.- ^ 
reflected in operational differences. This analysis is presented in 
Chapter III. 

Step 2-"-Time Use Difference . The difference in how time was 
allocated and used in each school at each of the two grade levels ^ ^ 



(Grades 2 and 5) was then summarized. The analysis for Grade 2 is 
presented ^ in Chapter IV and for Grade 5., in:Chapter„y.-i:: -^^^ 

Step 3 — Studefit Achievement Differences ; The presentation of 
,dif f erences in student achievement on each of the content variables for 
each of the schools was the next step. In Chapter VI mathematics per- 
formance for both Graide 2 and Grdde 5 is presen^^ 

J;' Step 4 — Predictive Analysis for ^Engaged Timev alt was pla^ ; that 
student on task behavior (as measured by engaged time) for eac^ 
objective and area in this; step would be- used as a/ dependent variables,:^ 
for each grade level. However, this regression analyses was not carried : 
final number of participating schools maide this analysis un-^^^^^^ s^^^^ 

feasible, . 

A second set of regress ion analyses was planned m 
Here student performance on content objectives for reach grade was^:^ 
as the dependent variable and the student pursiiits^^ariables^add^ 
the set of predictor variables. . A ^^rammary of this^^ a 
Chapter VII. \ 



Ill 

Schools and How They Group TT~' 7^ 

The study design specified that triads of schools would, comprise: the ^^^^^^^^^ 
sample. Within each triad, schools were to ; represent the ; same demographic.^^^fe^^^^ 
setting, differing on use of DMP and on adoption of IGE.^i Thus, ; within y;^;;^^ 
each triad, there wa[s to be one IGE school sett lng^using DMP, jone IGE^^^.^^^^;:>^^^^ 
school using an al c em at ive program, and one non-IGE school using DMP.f;' 
After school opening in fall 1978, the medium city IGE school using 
DMP withdrew from the study. Remaining triads and the schools in each 
of these — listed in IGE/DMP, IGE/rion-^P, and non-IGE/DMP order-r-are 
as follows: extreme rural, Schools 44^0, 4'28, and 904 Grade 2/905 Grade 
5; urban Schools 593, 333, and 762;^ and medium city , Schools 421,' 
and 906* Diff erences In operating characteristics among the three - 
types of schools , background variables, ' were anticipated to predict 
differences in the way in which instructional time was used; time use, 
in turn, was anticipated to predict student performance on objective- / 
based assessmgnts. \ ; ; / 

The schools/ are described by type in the following section. After/ \ 
the descriptions, scores on background and program use variables are pre-: 
sented and discussed. 



SCHOOL DESCRIPTIjOKS 
■ IGE/DMP- • ^ . 

School: 440 is located in a town of about 2,000 people and serves; 

children from the town and its surrounding rural area. It is /one of , 
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: since the program' s developmental stagjss .^^^ 

in sequence, with the students who began with DM^^^^^ ^ ; 

tinning with the program during 'each successive year. The school has . / 
approximately 50 students in each grade/ K-6.^ 

were interviewed each reported ^^hree to six years of :teachihg experienceV^^^:/^:: 
Within grade levels, two ability groups that remained relatively j^^^!^^^^^^ 
stable throughout the year were formed for math instruction. This ' 
stability is increased by the fact that the same six students ^ ' . 
were always grouped and observed together at each grade: level for the V ^: ^ ^ 
entire observation period. With the exception of occasional stud ent^^^v ^ 
teachers, no- one other than the teacher was involved in -implementing 
DMP. DMP topics were generally covered in -numerical , sequence without ; 
deletions. While both Grdde 2 teachers and one Grade 5 teacher used 
primarily DMP materials, including student guides,* workbooks, manipulatives 
and the resource manual, this teacher taught particular strands of DMP 
straight through rather than cycling through all strands/ -The other 
Grade 5 teacher supplemented the DMP program with a large number of 
worksheets. Observations were conducted of all teachers. 

School 593 is located in a town on the outskirts of a large 
midwest metropolitan area. Local small industries employ' the majority ^ 4^^ 
of workers in the town, so that its atmosphere is more that of a 
small to medium ci£y than that of a suburban community. This pre- ' ■ ' 
kindergarten-Grade 8 school has 45-50 students per grade and is the* -r^^'^ 
only school in the district. ^ \ 
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Both teachers who^ were interviewed reported -having^^^even or: more^^^^^fe^ 



years of" teaching experience; since Schoo"^! 593 organized its ^flrst 716^1 v 
Unit in fall 1971, it is possible that they and other teachers had; '/h; ^ ^ 
participated in Witial lGE implementation steps,- - /^^^ 

children according to the Instructional Programming *Model; the' principalp?^; 
noted that student Wroups were baseji on a test administrated at the , 
beginning of the year and observation showed the same six students 
were always together. v | ' 

Second-grade classes were provided in an open area that also included 
pre-kindergarten, 'kindergarten, and first graders. Both classes^^partici-. 
pated in testing, and .observations were conducted in one class that was^:^^^^^^.;i 
occasionally taught by a student teacher. Fif th-grade ; staff ;and , students : 
were in self-contained classrooms separate from the :rest of the school 
, However, students did move from one area to another for both math and ; 
reading instruction. As at Grade 2, both fifth grade classes were 
tested but obseirvations were conducted in only one of / the classes, ^^;v: 



IGE/non-DMP 

" ' ■ ■ ■ ■■■ . ■, ■ ■ ' ■ ■ ■ 
School 333 is in an area describe'd as urban fringe, a suburb of a 

large midwest city. The -building has two open areas, one for each of ' 

Grades 1-4 and 4-6; the kindergarten area, is separate. There were ^ 

approximately 60 students jii each grade , and of the three teachers 

interviewied,. two reported seven or more years experience and one, 

three to six^^years. 

At Grade 2, math was taught for 30 minutes each morning. ^Tbe two 

teachers sometimes worked together with the entire: group of children, 



although each also taught separately. One text/workbook series .was the 
basis for second-grade instruction and a large number of teacher-made : ; 
materials w^re also used. .The math program for the upper grades is 
based on sets of objectives defined for decimals/ fractions, geometry^ 
multiplication, and* so on. At the beginning of the 50-minute instructional 
period, children first checked in with an aide to see^i^ich area they .wer^ 
to work in, then picked up the appropriate materials. Although each work - 
area in the 4-6 unit was supervised by a teacher, this'^teacher ra:pely 
worked^^ith^the entire group; Rather,, individuals worked on their own, 
getting help from^the^ teacher as needed ov having the teacher check thieir 
work. Once particular sets ol^^objectives were completed, students moved 
to a self-contained testing room where^they took tthe appropriate exam , 
for their objective and then were immediately recycled into v ^ 
another learning are.a« Thus, even though the same sd^o^lii^ 
' observed during the entire observation period, these six students were"^^^^-^ 
always working on different skills. The math program was truly "individ- 
ualized" in the sense that each child progressed-alone.and was seldom 
associated with a larger group of children. 

School 421 is located in a mejiium city with an economy based on small • 
businesses and farming and with a medium-sized university. The school is 
K-6, has been an IGE school since .1969^. and has approximately 60 students 
in each grade. The relatively modern school building has a central IMC ' 
and self-contained classrooms, as well as more open instructional areas • 
around the perimeter. During the 1978-79 school year, the two fifth 
grades were located in self-contained rooms; however; the fifth-grade • 
vteacher decided not to. participate in the study after the first few 



day's so no data were collected on these children. 

The '58 second graders were part '^of the second "cbnmi or unit { v 
within the school and were grouped with first and third graders. They 
occupied two adjacent open instructional areas, ' Varied groupin 
materials were used during instruction at Grade 2 , and as evidenced some 
regrouping did occur during the observation period. Sixteen observations 
were conducted during the study period. Target students were selected x 
from a group of 28 students reported by the principal to be average or 
below average.' The two second-grade teachers who were interviewed each 
reported two to six years of experience, [ \ ■ ■■• ■ ■ ••. : 

School 428 is a K-4 school in a K-12 district located in a very 
small rural community. Many of the town's adult residents commute to ; ; 
larger towns 10-20 miles away or work on nearby farms or in the town's 



one small industry. There is concern about the declining elementary 
enrollment. The school has used IGE since 1971; math and^vreading in- 
struction follows an IGE model, and social studies is expected to soon- 
be reorganized following IGE procedures. Staff stability is high with 
both fifth-grade teachers reporting seven or more years experience an^ 
"the^s^cond grade teacher three to six years, ^ 

In the^JC^2 unit. Instruction was provided separately 



by grade. For mathematies,:^^both second--grade ability ^groups were taught 
by one teacher for nine weeks while"^ he other teacher ins^rsucted the 



four ability groups formed for reading. The two ^ability groups used i 
for Grade 2 mathematics instruction were based on results of "^te&^ing at 
the beginning of Grade 1; few children were changed from group /to grdup 

/ . ' • 7 ^ 

for math instruction during either Grade 1 or Grade 2, In the 5-8 : 
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unit, there are three potential fifth-grade teachers but only one was 
observed. As at Grade 2, instruction was generally provided in larjge 
groups followed by individual seatwork and, as shown by the observation 
records, students- were not frequently regrouped by skill needs within a 
school .year or even across years, ' \ : . / 

School 762 is. In a large western metropolitan area in a neighbor- 
hood with a high proportion of adult residents on welfare or riot reguiarly 
employed; this is considered a Title I school. About 65% of the students 
were Chicano with most others being black or of another minority group. > 
The school was K-6 and had about 80 students in each grade. Both of 
the teachers who were interviewed reported three to six years of teaching 
experience. 

,This school was the only one using ,pi4P In the- school district and 
both teachers' and a:dministrators' attitudes towards the program were 
very positive, Manipulafe^ves and varied group sizes were .used; with each 
child's daily program* dividfe^ into three sections—an individually * 
prepared seatwork assignment, \, computation small group, and a DMP- . 
topic small group directed by the "teacher , DMP content was taught 
in strands four days each week, and new; students w6re pre-tested- to 
determine their skill needs. Tests and obsTervational data were obtained 
in each of the Grade 2 classrooms; however , since. the Grade 5 staff 
declined to participate in the study, no Grade 5 data were collected, 
-Schools 904 and 905 are elementary (Grades K-3) and intermediate 
(Grades 4-6) schools^ to-aco system drawing on a mixed 

"socio-economic base near a larger southe^n-^metropol it an area; both 



were Title I schools with fewer than 20% of the- students beiiig black. 
Each school had about 625 children. Because a bond issue had failed,, 
classes were quite large and it was not anticipated that money would be 
made available for needed expansion of the schools in the near future. 
The second-grade teacher reported having seven or more years experience; 
the fifth-grade teacher had taught only one full year prior to the .study. 

The district had approved "^DMP and ^teachers could decide which 
program they wanted to use. Within a program, however, teachers were \ 
Issued materials for their grade only and thus were quite conscious 
of the distinction between a Grade 4 DMP topic, for instance, and a 
Grade 5 DMP topic. Although students were regrouped by skill needs 
for reading instruction, they were not regrouped or cross-age grouped 
for math, tonipulatives were used, especially at Grade 2, in which 

DMP was the primary program. At Grade 5 DMP was iised as a supplementary 

■ ' " ■ ' / 

program. One class was tested and observed at each grade. 

■ ■ ' ' ■ ' - . "■ 

School 906 is one of nine K-5 elementary schools in a medium city 
that has both a large state university and an automobile plant. It 
serves about 350 children. The school's neighborhood has modest homes 
with about 20% of the children of non-white . heritage. The district^ 
textbook committee Had approved two mathematics curricultim programs, 
leaving purchase decisions to be made by school staffs. At School 906, : . 
DMP had been used alone for three years. At Grade, 2, tests and observations ; 
were conducted in one self-contained' classroom of about 25 students/ The ■■■'>' 
two fifth-grade teachers team taught in a -larger area with about 50 students. 
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Although students in this group were regrouped by skill level across subject 
areas, they were not regrouped within a subject area; the math groups devel- 
oped at the beginning of the year were not substantially altered during the 
observation period. The same six children were always observied at both 
Grade 2 and Grade 5. Since the staff at this school did not participate 
in structured interviews^ background variable scores could not be 
developed. 

SCHOOL SCORES 

Background variable Scores are shown in Table 3 for , each school . 
separately; averages for the three school types and the total sample are 
also provided. The first four variables (lOR/ IOS,. GdS, and IPM) represent^^ 
IGE characteristics; the next two (TEXF and DB) were included for descrip- 
tive purposes; the last two represent program use. 

IGE/DMP 

Background variable scores for School 440 were midrange relative both t< 
other schools in the study and to possible score values. The lOR score was? 
6.25/12; GOS, 14.75/24; lOS, 17/29; and IPM 52.75/120. For DMPlmplementatic 
School 440 received 9 of\ 10 points; for program customizing, the school re- 
ceived a quite different v5 of 6 points. 

On three of- the four background .variables. School 593 scored high both 
relative to the maximum possible score and relative to other schools in the 
study. The GOS score was 18/24; lOS, 26/29; and lOR, 9/12. For use of the 
IPM, in contrast^ the score was 34/120, second lowest in the study. A 
similar contrast emerged in the j^rogram use scores; for extent of DMP im- 
plementation School 593 received the maximum 10 points; for program customi- 
zing. School 593 received 1 of 6 possible ppints, the second- lowest score in 
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the study. Thus, School 539 seeins to have the overt structural character- 
istics of an IGE school but to provide instruction in a rigid mechanical 
manner. . - - 

... ' " ■ \ 

IGE/non-DMP 

Background variable scores for\ School 333 was quite good for lOS 
(27/29) and lOR (8.25/25/12), and moderate for GOS (13.25/24) and IPM 
(58/120). These scores ranked first; third, fourth, and fourth in the 
study. ' On program customization. School 333, like five others, scored 



1 of 6 points. 



School 421's GOS score was $.50/24, lowest in the DMP study. Scores 



on the other three background variables were quite different: the lOS 
score of 26/29 was second highest; both\ the lOR score (10.5/12) and the 
IPM score (80/120) were highest in the study. For pirogram dustomization. 

School 421 scored like six of the eight schools, 1 of 6 possible points. 

' ■ • . ' ■ ' " ' 

Background variable scores for School 428 were midrange for lOR 

(7.5/12), GOS (10.75/24), and lOS (14/29); the IPM score was relatively 
■ . ■ ■. ' ■ 

higher (71.75/120), and relatively closer to the highest score in the study • 

• • ■ ■ ■■ ■ J . .... V . . ■■■ ,.' ■ ' 

For program customization^ School 428 had a score* of 3.5 out of 6 possible 

points, the highest in the DMP study. 
Non--IGE/DMP 

Background variable scores for School 76'2 varied from midrange for lOR 
and lOS to high for GOS and IPM. On lOR th^ score was 6/12, sixth in the 
study, and on lOS, 15/29 or fifth. On GOS, tile school's score was 15/18 
and on 1PM, 77/120; both of these scores were second highest; School 762 
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obtained the maximum 10 points for DMP implementation. For program 
customization, the schools' score.was 1/6 like that of five others in 
the study. 

On the three background. variables that reflect school-wide and district- 
wide characteristics. Schools 904 (grade 2) and 905 (grade 5) had similar 
scores with School 905 higher than 904. The schools differed more and 
904 had higher scores than 905 on two ir^structional variables, use of 
the IPM and extent of DMP Implementation, Both Schools 904 and 905, as 
well as four others in the study, had low scores on program customizing, 

DISCUSSION 

For both GOS and IPM, the non-IGE schools averaged slightly above one 
of the groups of ICE schools and had ranges that overlapped those of both 
groups of ICE schools. The,, overlap also occurrfsd with one group of JGE 
schools on lOS and nearly occurred on ICR, although th^ non-IGE schools 
averaged much lower than IGE schools on these variables. Thus for these 
IGE-related scores, the label IGE school was not useful in grouping schools."^ 
Rather than reject the idea that in schools with similar operating charac- 
teristics instructional time was used in similar ways and student performance 
outcomes were similar, we submitted the background variable scores to a 
cluster analysis. 



IGE was not developed or disseminated as a simple new idea. Rather 
IGE is a synthesis of many existing ideas, which, implmented^^^ t^ 
represent a comprehensive alternative to traditional schooling. (For 
additional information, see Klausmeier, 1977.) It is not surprising, then, 
that schools not self-labeled IGE have characteristics that one would expect , 
in an IGE school . 



CLUSTER ANALYSIS 

This analysis groups cases. In this Instance schools. Into pairs, 
triplets, and so on. The basis for grouping is the scores on the 
variables. Grouping continuies until all cases ar,e combined; at each 
step, the school added to a cluster is the one with variable score's 
least different from the variable scores of the existing cluster. The 
particular program used was^ P2M, cluster analysis of cases (April 1977 f 
revision), from the Biomedical Computer Program series developed'^at the^ 
Health Sciences Computing Facility, UCLA. Euclidean distance was the 
measure used; all variable scores were standardized. ^ .. _ _ 

Two cluster analyses were carried out. The first used only background 
variables (lOR, lOS, GOS, IPM, TEXP, and scaled DB).yFor the second 
analysis, the two program use variables were add ed^ Results of both 
analyses are shown in Figure 5, Schools 440 and 762 clustered in both 
analyses with an amalgamated (combined) distance of approximately 1.5. : 
In the analysis with background variables onlyj school 428 was added to 
that cluster with a slight addition to combined distance and schools 333 
and 593 clustered with a combined distance of 1.555; no other combinations 
with a distance less than 2.0 were formed. In the analysis using both 
background and program use variables, different clusters were formed 
with much greater distances. 

I Because the study design included prediction from background 

variables, the results of the first analysis were used to specify one 
cluster of three schools, one pair of schools, and three outliers. 
Averages for the clusters are shown in Table 4; scores for the schools 
are repeated from Table 3 to permit study of the results. 
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Figure 5. Cluster groups and distances. 
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mum possible score is given in parentheses. \ 
Grade. 2 participated. . ' 

Grade 5 Participated • / \ 
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The three schools in the cluster average low on IOR> lOS, and 
DB relative to the pair of schools and high on IPM. The two groups are 
not differentiated on GOS scores. Average scores on IPM are quite 
different for the two groups, although there is some overlap. School 
421 -resembles the pair of schools on TOR, IOS» and DB but has a GOS 
score much lower than any other school in the study and has the highest 
IPM score. Schools 904 and 905 are the elementary and intermediate 
schools in one rural district; scores from School 904 will enter into 
the Grade. 2 analysis and scores from School 905, the Grade 5 analysis. 
These two schools are much lower than all others on ICR and lOS and 
lower than most on GOS: School 904 is fairly Ig^w on IPM, while School 
905 is by far the lowest in the study, ' * 

In considering the utility of these school groups, it is useful 
to review what- the variable scores measure. DB is purely descriptive.' 
lOS is a measure of the paper organization of the, school rather than the 

, ^:, i\- ...... ; . . ■ . • ^ ' . . 

actual operation; for example, lOS scores reflect, in part, whether 
staff and students are organized in mbltigraded units rather than : ' 
whether instruction is provided to multigraded groups of students.: 
Three school features are represented in the lOR scores: "parent visi- 
tation/participation, district support for the school 'spreading program, 
and regularly' scheduled meetings with representation pf other schools. • , 
IPM scores are a sum of seven scores, each representing the school's 
implementation of one step of the IPM,*as follows: 1 setting schoolwide 
instructional objectives, 2 selecting a. subset of those objectives for 
students in teacher's instructional units, 3 assessing to determine ^ * 



students' instructional needs, 4"^ planning instruct ional^^^^^^^^^ 
on those needs, 5 providing instrtictibn; with- var 

both instructional heeds and ' learning' styles, ; 6 , reassessing. toVdetermihe^^^:; 
effects of : Instruction, and 7 -l feedback ap 
tiohal objective. Variations in IPM tot a^^ 
in Vyaribus subscores within .^nd across group sV- ' ^^^^ 

Scores on the GQS , ; which primarily distinguish;^^ outliers i from:.; - 
schools in groups, reflect the quality of new teacherv orientation (in^^^^^^^^.-# 
schools/ that have appreciable teacher turnover) i t he^^^xtent of- ihservicia-^^^^^^^ 
opportunities,, and, with half the;weight of the previous two features, 
the amount of( release time for instructional planning. 

Thus^ the difference between two groups in lOR scores appears to - 
be the only important consistent difference. It is insufficient to 
justify analysis by cluster. /Therefore, analysis based on background 
and program use variables will include -^seyen different schools at Grade 2 
. and five schools at Grade 5. " 

. . ; - CONCLUSIONS ■ ! ^ - v^^^ 
Examination of the background, and variably scores indicates that . 
\the original hypothesis, that dif ; vi'^ances in background variables among 
types of schools would be useful jredictixTig time use, means of 
instruction, and pupil performance, is not sensible to test. The labels 
IGE school and BMP user to classify schools, but by intent rather than v 
by actual operation. 
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Time Use in Grade 



^ Time allocated to mathematics instruct ion /'the^^^ 
^teachers intended to spend on various/mathematics topics ^^^^^^^^^^^ 
measure of opportunity to learn . Th/ number o*f hours allocated 
^overall indicates the relative importance of mathematics In the 
elementary ^urriculum at various schools. Broken dowi by -objective, 
allocated time informs us about t^e focus of instruction at various 
schools. /However, not all of the^ time allocated to a particular 
curriculum area is active learnirlg time for the students. A portion 
of the t Me, usually quite small/, is not applied to the planned 
topic; during this time, stuiierits might be making the transition 
from the previous, subject, participating in classroom management 
activities, or working on othJr content. During the remaining time, 
that available for instruction in the content area, all students 
are not always engaged in th6 instructional activities; some may 



be passing o)|it papers, waitihg for assistance, or sl^ paying 
attention. 

, In this copter, time ^'is first discussed as it was allocated to 
the general objifctives. N^xt observed time is discussed as a pro- 
port i,on,-f log allocated dime. Available! and engajged time are thm. V; , 
discusfi;ed as proportions ri^ observed allocated time. : Finally data : 
are presented about variables representing the instructional process: 



■ ■■■ >. 
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use of thr^e grouping patterns, use of three (different types of 
materials, and the relative amount and origini of talk in . the classropm. ; 

Summary tables in this chapter.are derived from data given by ur^ 
Nerenz and Webb .(I98pb) and We^^ 

tables are arranged by label group (IGE/DMP, IGE/noh-DMPi' 
non-IGE/DMP) with cluster group indicated l^y T; for. the triplet of 
schools, P for the pair of schools, and — (dash) for the 

Allocated Time 

The total hours of mathematics instruction per child and the * 
assignment of those hours to the 11 general objectives are given in 
Table 5. Overall, hours allocated during the 25-week study 
ranged from just over 40 at School 333 to over 90 at Schools 593 
and 906. Clearly, addition and subtraction of whole .pumbers (04) 
is the heart of th^ second-grade mathematics program; regardless 
of curriculu^a program used. At . the DMP schools, writing numbers 
(01) and word problems (12) both had a substantial proportion of 
time allocated. At the non-IGE/DMP schools, over 10% of the time 
was allocated to fractions;* (07) . At th^ various schools, different 
general objectives had been .identified for additional emph;asis: 
geometry (14) at' Schools 440 and 762; miscellaneous topics (15) 
at Schools 593, 428, 421, and'333; and other place value (03) 
also at School 421. At School 906, time was allocated to only 
seven of the eleven general objectives; at other schools, time was 
allocated to nine or more of the objectives. 



Writing 
Numbers 
01 

Hours % 



■Table 5 

Grade 2 Average Allocated Hours of Math Skills Instruction per Child 
Over the Total Study Period 

'., V General Objective 



Inequal- 
ities 
02 

Hours ■ Z 



Other place Addition , 

value or and Multl- 

numeratlpn Subtraction plication Fractions 

03 ) 04 05 . . • 07 .- 

Hours :X Hours Z Hours Z Hours Z 



18.7 
14.2 
16,5 



3,2 
.3 
.3 

1.3 



31 
15 
21 



1.8 
1.0 
1.4 



3.9 
..0 
.2 
1.4 



.5 

1.8/ 
1.2 



1.5 
9.3 
1.8 
4.2 



3 
17 
4 
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Heasure- ^ 
. nent . 
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Hours X 



Word 
Problems 
12 

Hours -Z 



Appli- 
cations 

. 13 : 



Geometry 
14 • 



Mlscel- 
^ laneous 

15'-'- 



TOTAL;: 
HOURS 



12.2 
39.0 
25.6 



22.2 
24.7 
26.5 
24.5 



20 
42 
33 



47 
45 
64 
51 



1,4 
.5 
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1.4 
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3.8 
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4.2 



2.3 
3.1 
1.7 
2,4 



15.0 
16.5 
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icated tiae Is indicated by -; less than .05 hours is Indicated by .0.- 0+ Indicates less than 

la'tourfwereluicawrdurlnron^^ h'h'Jm'""' 5" l'"'' ""^'^^'yf was allocated equally to all chUdren, f or. who. logs were maintained; that 

»ed.for 6 c\ud\^e°^^^^^^^^^^^^ been recorded as 3 hours per child.where logs've^ ' 
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IGE/DMP . Each of thesje schools allocated over three-quarters 
of the mathematics instructional time to three basic objectives: \ 
writing numbers (01) , addition; and subtraction of whole numbers (04), 
and word problems (12), / \, 

On the average, each second grader at School 440 was scheduled 
for 2,2 hours of mathematics instruction each week. During the study, 
nearly one-third of the time was allocated to instruction in writing 
numbers in expanded notation, one-quarter to wo ird problems, :and one-, 
fifth to addition and subtraction of whole numbers. Thus, three- 
quarters of , the year's mathematics skill instruction was devoted to 
these three basic objectives aiid an additional' 10% to geometry. 
The time devoted to addition and subtraction of whole numbers was 
distinctly less, both in hours and in percent of time, at School 440 
than at any other school. 

At School 539, 3.4 hours per week of mathematics skill instruction 
were scheduled, on the average, for each child. At this school, as 
at School 440, three-quarters of the allocated instructional time 
was scheduled for instruction in the three basic objectives but \i^th 
a different emphasis: .42% for addition and subtraction of whole 
numbers, 18% for word problems, 15% for writing numbers. An 
additional 13% of the instructional time was allocated to miscellaneous 
topics such as time, money, and graphs. ^ 

Non-IGE/DMP , At two of these three schools, as at the two 
IGE/DMP schools, about three-quarters of the time was allocated to 
the three basic object-ives; at the third, nearly two-thirds. At 



least 11% of the time at each of these three schools wa^.;allocated^^^^^^.^- 

to measurement of length and capacity, much more time ithan at other ^^^^ ; 

schools. . -:/: 

At School 904, on the average, each child was scheduled for 1«8 : . 
hours of mathematics Instruction each week. Time was distributed 
across the basic objectives in the following manner: 44% to addition 
arid subtraction, 19% to word problems, and 10% to writing numbers. 
Measurement was scheduled for 11%. 

■ ' ' . • ■ ■ . . " ■ . . ■ -■- 

At School 906, 3.3 hours of mathematics instruction was scheduled, 

on the average, for each child each week. Word problems were allocated 

38%; . addition and subtraction, 29%; writing numbers, 11%. An additional 

11% was allocated -to measurement . 

Second graders at School 762 were sch'eduled for an average of 2.1 

hours of 'mathematics instruction each week. Of this time, 36% was 

■ ■ * ' ' - ■ h 

allocated to addition and subtraction, 17% to word problems, and 9% 
to writing numbers. Measurement wa^ scheduled for 14% .of the time at 
this school and geometry for 11%. 

IGE/nori-DMP .. At these three schools, addition and subtraction 
was the only basic objective to be scheduled for a large proportion 
of time and the. proportion was larger than in the other two types of 
schools. The miscellaneous topics such as time, money, and graphs 
were allocated fairly large proportions of time at two schools, one 
of which also allocated considerable time to place value and numeration. 
At the third school in this group, the relatiyely little time riot U. 
.allocated to addition and subtraction was spread among four other ; 
objectives including the miscellaneous topics. i ^ 



At School 333, an average of 1.5 hours per week was allocated to 
mathematics instruction. The strong emphasis on addition and subtrac- 
tion is evidenced by its allocation of 64% of the instructional time. 
Fo\a^ other objectives were allocated between 5% and 10% of the time:, 
miscellaneous topics^ 9%; multiplication, fractions, and geometry, .6% 
each. 

At School 421, an average of 2 hours was scheduled for mathematics 
instruction each week. Addition and subtraction was allocated 45% of 
the time; miscellaneous topics and place value, 17% each. Fractions 
were allocated 7% and measurement, 6%. : 

At School 428, on the average children were scheduled for 1.7 
hours of mathematics instruction each week. Addition and subtraction 
was allocated 47% of the total time; miscellaneous topics, 19%» At . 
least 5% of the time was allocated to each three additional objectives 
at this school: 5% to measurement, 7% to writing numbers, and 8% to ■ 
inequalities. . ^ 

Proportion Observed ri^^ 

The relationship of observed time to log allocated time is shown 
in Table 6. As was stated earlier, 18 or more formal observations 
were made in each second grade (during the 25-week study. Since testing 
occurred in six weeks during the period that teachers maintained logs 
of allocated time. for the target students, observations were made in 
most of the remaining 19 weeks. 



. Table 6 

Relationship. of Allocated Time and Observed Time by Objective 



Observations 



General Objectives - 



CLUSTER' 



No« 



Other place . Addition 

: of Writing Inequal- value-or and Multi- Measure- Word Appll- Miscel 

Total Allocated .Numbers itles .numeration" Subtraction plication Fractions^ nent ; Problems cations Geometrv'^^ 

Hours Time 01 02 03 04 05 07 11 12 13 -^^J^^f 
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— , •••• 
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11.- 


iiie 


5,13 



h general objective, the proportion of allocated time is given first',' followed by the proportion of observed time. 
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Overall, from li% to 24% of the log allocated time was observed. 
In most cases, the relative emphasis on general objectives that: was 
shown in the logs was maintained in t hie observations; for example, . 
for Objective 01, little or no instructional time was observed in 
these schools in which a small percentage of time had been Allocated, 
and approximately the same percentage pf_tJ^ 

where 10% or more of the instructional time was allocated to Objective 

01. ^ ■ / 

Nonapplied Time, Available Time, and Engaged Time 

Formal observations were made during the time period in which 
mathematics instruction was scheduled in each school. Data on time 
use were developed from these observations. Briefly j the time lise 
variables are as follows: nonapplied time, the portion scheduled 
for but not devoted to mathematics instruction; available time, the 
difference between scheduled observed time and nonapplied time; 
engaged time, the. portion of available time that students were 
pbse.rved to be attending to instructional activities. ■ (These 
variables are described in more detail in Chapter II.) 

As shown in- Table 7^ the percentage of nonapplied time, 
and of course available time, varied among schools with the 
primary source of variation being School 762. Although the pair 
of Schools 333 and 593 seem well matched. Schools 904 and 906, outliers 
in the cluster arialysis, are similar to them. Schools. 428, an 
outlier, and 440, one in the triplet, are alike in nonapplied 
and available time. 
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' ; . - Table 7 
Nonapplied Time, Available Time, and Engaged Time 
as a Percentage of Observed Allocated Time, Grade- 2 
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At both Schools 762 and 421, students were engaged in instruc- 
tional., activities during less than half of the observed aMocated 
time. At all other schools except School 400, Students were engaged 
during two-thirds to three-fourths of the observed allocated time, . 
the pair of Schools 593. and 333 had very similar engagement rates, " 
69% and 70% respectively, with the other three schools differing by 
a few percentage points. Again, analysis seems appropriately 
conducted on individual schools, rather than on label or cluster 
groups... - ■ V n-.,; ■ 

The allocated instructional hours for each child from Table 5 . 
and' the overall percentage of engaged time from Table 7 together 
provide estimates of the time allocated to mathematics instruction each 
week and the average ^engaged time for each child (Table 8) . = 

At Schools 593 and 906 nearly 4 hours were allocated to mathematics 
instruction each week, about 45 minutes; a day. This allocation is 
highest in the study, half again as much as at schools with the next, 
highest allocation. Because the engaged rate was fairly high at these 
schools, the estimated hours per week of engaged time is also highest 
in the study, about two and one-half hours a week. 

At Schools 440, 428, "and- 904, about one- and; one-half hours a week 
are estimated for engaged time. Allocated hours were higher at Schojl' 
440 but the: engagement rate at that school was low enough that estimated*" 
engaged time for that school was the same as that for schools with 
20% Less allocated time. 
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Estimated Hours Allocated and Engaged for Each Child Each Week, Grade 



Hours Allocated per Child . Engaged Time * 



, Estimated ' 

SCHOOL CLUSTER Total Study^ Per Week Hours/Week 
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2. 
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70 


1.9 


Grand Mean 
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2. 


5 


62 


1.6 



'0 



From Table 5. 
From Table 7. 



V About an hour a" week was the efistimateci engaged time at Schools 
421V 333,. and Ti*2. The effects of engagement ^ rate, are even more^ 
draniatic for tUiU ^roup of schools, with the least time allocated to 
mathematics iiki:^r^:uction at ScJiool 333 and the most tlmfe estimated * 
engaged each vvi4el^. | 

:•■ , /. . f - . r : :.. ^1 ■ • . 

Means of InstrWtioia . , . • 

r Use of tfie three group ;=5i2es and three priliary types bf materials 

&ad ' Incidence of -te^cher .and .stiidenJ: interactions ai:e_ suinmarized in_ 

■ :■ ^ - ■■ ■■ ■■■ ■■: ■ ' ' ■■ . ■• i ■ - 

Table 9* For none of thetse instructional variables did a consistent 
1 -pat teira emerge for label groups or for cluster ip;roups. Average 
differences .due .to one or two extreme scores and overlapping ranges 
are typici*! of ibe label groups. For example, although the averages 
show that" individuai wrk wa«f o 

time at the DMP schools, tlt^e raDge of the DMP schools overlaps the range 
of th>ij noh--Dl<P ^'chdolsr two very low proportions are from DMP 
Schools 440 ;^and 904 while the one very high proportion is from non- 
D^^? School 333 v. 'S'imilarly, from the means for the triplet and of 
schoola,thecluster analysis appears to have identified two sets 
of schools th^t use lar^e and small grp distinctly different 

proportions; however, the propor^tions from outl^^ School 904 are 
inorfe like fclib^^^^^ and 762 than are the proportions 

. Vipr trlplet member school 440* ' Thus, the discussion ' below of ^ V . -^ 
grovping patternsv-^^u and classroom interactions . 

.; Is based on overall patterns. 



Arable 9 

Instructional Prices sv Variables as a Percentage 
of AvallableyTime, Grade 2 
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Materials 



Interactions 



T 



Paper Manipu- 



SCHOOL CLUSTER 


Individual Small 


Large \ Special lative 


Print 


Teacher 


Student 


tge/dmp 






1 \ 












.>40 T 


38 li 


11 


1 s A 


77 


45 


,0 


25 


9 


,593 ' P 


65 






51 


5 


44 


9 


11 


• Mean 


52 




39 ^ 


\64 


25 


22 


17 


10 . 


IGE/non-DMP 


















428 T 


61 




37 


^0 


9 


1 


12 


' ' ' ■ '. V 

8 


421 - 


69 


20 


12 


.if 


12 


■ 0 


9 - 


8 ,. 


333 P 


82 


k 


15 


85 


0+ 


45 


9 


10 ■ 


Mean 


71 


i 

? 


21 , 


8^ 


7 


15 


13 


9 . 


nhn—TRK /DMP 
null xuu/i^Lijr 




1 
i 




i 










904 


57 


1^ 


38 




8 


31 


12 


■ ■ 5 •' 


906 - 


34 . 


22 


44 


82 \ 


76 


11 


19 


12 


762 T 


56 


'6 


38 


80 1 


23 


7, 


13!^ 


■ 6 ■ 


Mean 


.49 


11 


40 . 


83 1 


36 


16 


15 


8 ; 


Triplet Mean 


52 


6 


41 


82 1 


26 


3 


17 


" 8 


Pair Mean 


74 


6 


22 


68 




45 


9 


11 : 


Ground Mean 


58 • i 


10 


33 


79 


22 


17 


14 




^ercents may not sum 
Percents need- not sum 


i ■ 

to 100 due to rounding. 
■ to, 100. . ^/.■■ 

■ / ■ .' 
' ' I ■ ■ ' ■ ■ ■ ■ 

, 1 
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Paper-and-pencil materials ^re used over three-fourths of the 
time in seven of the eight schools and over half of the time at the 
eighth, School 593. That school and School 333, paired in the 
cluster analysis, are similar in their low rate of use of. manipulatives 
and high rate of use of printed materials; at School 904 materials 
were similarly used. 

At Schools 440, 428, and 421 printed materials were rarely used. 
At School 440, manipulatives were in use nearly half of the time but 
only about 10% of the time at the other two schools. 

Variability was greater in proportion of teacher interactions 
than in proportion of student interaction. In addition, there was 
generally a larger proportion of teacher interactions than student 
interactions. At the two exceptions to the latter observation, 
Schools 593 and 333 i there was little difference in the percentages; 
a very small difference in the two proportions also* occurred at 
School 421. ' 

Interactions were observed about 20% of the time in most schools". 
At Schools 440 and 906, interactions were observed about one-third 
of the time. ... 
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Time Use In Grade 5 . 

Htme allocated to mathematics instruction, the amount of time teachers 
intended to spend on various mathematics topics, is a gross measure of 
opportunity to learn. The number of hours allocated overall indicates ' 
the' relative^ importance of mathematics in the elementary curriculum at 
various schools. Broken down by objective, allocated time informs us 
about the focus of instruction at various schools. However, not all of 7- - 
the time allocated to a particular curriculum area is active learning 
time for the students. A portion of the allocated time is not applied 
to the planned topic; during this time, students might be making the 
transition from the previous subject, participating in classroom manage- 
raent activities, or working on bther content. During the remaining time, 
that available for instruction in the content area, all students are not 
always engaged^' in the instructional activities; .some may be passing out 
papers; waiting for assistance, or simply not paying attention. 

In this chapter, time is first discussed ah it was allocated to the . 
general objectives — this data comes from teacher logs. Next, observed 
allocated time is discussed as a proportion of log allocated time. Avail- 
able and engaged time aire then discussed as proportions of observed allo- 
cated time. Finally data are presented about variables representing the 
instructional process: use of three^ grouping patterns, use of three 
different types of materials, and the relative amount and origin of talk 
in the classroom. 

Summary tables in this chapter, are derived in part from data given 
by Nerenz and Webb (1980b , 1980c) and Webb and Nerehz (1980a) . v 
The tables are arranged by label group (IGE/DMP, IGE/non-DMP, 
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and non-IGE/DMP) with cluster group indicated by T for the two schools 
originally in the triplet, P for the pair of schools, and — for the two 
othexs. - 

Allocated Time 

The estimated total hours of mathematics instruction for each child 
and the assignment of those hours to the general objectives are given in 
Table 10. In developing this table it was necessary to assume that 
time for each objective was allocated equally to all children for whom 
logs were maintained; that is, if 18 hours were allocated during one 
period to Division (06), that time would have been recorded as 3 hours 
per child whe.ire logs were maintained for 6 children, 2-1/4 hour3 per 
child where logs were maintained for 8 children, and so on. 

Overall hours allocated during the 25-week study ranged from nearly 
70 at School 593 to over 90 at School 440. There was no general pattern 
of instruction differentiating the label groups, although the non-IGE/DMP 
schools were more similar than the other two groups. The cluster groups 
were similar ^.n breadf:h of instruction: at Schools 440 and 428 from the 
triplet, some time was allocated to all 12 general objectives; at the 
pair of Schools 593 and 333 time was allocated to 7 and 8 general objec- 
tives, respectively. At School 906 time was allocated to all objectives, 
and at School 905, to 10 objectives. 

^Division (06) was the only general objective to which all schools 
allocated a substantial proportion of time. All schools except School 593 
also allocated at least 10% of the time to Fractions Computes (08). At 
School 593, a third of the. time was allocated to Decimals Computes (10), 
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SCHOOL 



Table 10 

Grade 5 Average Allocated Hours of Mathematics Skills InsLruction 
per Child Over the Total Study Period, by Objective 

' General Objective. 



OA 

CLUSTER Hours 



05 

Hours X 



06 

Hours X 



07 

Hours Z 



08 

Hours % 



09 

Hours X 



10. 

Hours % 



ICE/DMP 
AAO 
593 
Mean 

ICE/non-DMP 
A28 
333 
Mean 

non-IGE/DMP 
905 
.906 
Mean 

Triplet mean 

Pair mean 

Grand mean 

Standard deviation 



2.7 3 
3.0 A 
2.9 

.9 1 
.5 



.6 
1.3 
1.0 

1.8 

1.5 

l.A 

1.2 



11.0 12 



5.5 



8.5 
6. A 

22.0 
18.0 

20 

9.8 

11.0 
8.0 



10 
8 



?.9 



16.7 
18.9 
17.8 

•16.7 
13.0 
1A.9 

\h , 6 

r 

n; . ?■ 

16.7 
2.6 



18 

27 



20 
15 



19 
2A 



28.0 
13.8 
20.9 

17.7 
5.6 
11.7 

8. A 
12.9 
10.7 

22.9 
9.7 

U.A 
2.6 



31 
20 



22 
7 



11 
15 



13.3 
A. 7 
9.0 

8.5 
17.6 
13,1 

20.0 
1A.5 
17.3 

10.9 

11.2 

13.1 

5.7 



15 
7 



10 
21 



26 
17 



.3 
1.1 
.7 

2.8 

1. A 

.3 
A. 5 

2. A 

1.6 
.6 
1.5 
1.8 



.5 
22.9 
11.7 

6.5 
3.0 
A. 8 

2.3 
1.5 
1.9 

3.5 

13.0 

6.1 

8.5 



X 

33 



NOTE: No allocated t//4 iru: .catecS by — ; las^i than .05 hours is indicated by .0. 0*** indicates less than 0.5%. 
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Table 10 (continued) 



P 



\ 



General Objective 



11 V ,12 13 14 15 TOTAL 

CLUSTER Hours % Hours % Hours % Hours %. Hours %. HOURS 



T ^.9 5 .2.4 \ 3 1.8 2 3.7 4 5.6 6 90.9 



— --, . -- -- - , 4.9 . 7 69.3 

2.5 . 1.2 ,\ .9 1.9 5.3 80.1 



T 3-2 4 3.2 . 4 ^ 1,1 1 3.7 5 9.4 11 82.2 

P . — — 4.8 6 - 19-.5 23 ,15.2 18 85.1 

4.0 .6 \ 11.6 ' 12.3 83.7 

\ i 

\. . / ■ ■ ■ 

- ' — 3.6 5 - \ 4.2 5 ■ .9 1 76.9 

6.7 8 1.6 2 1.0 1 \l.5 2 ' 1.6 2 85.2 

3.4 2.6 .5 2>9 1.3 81.1 

4.1 ^';8 1.5' 3.7 \ 7.5 86.6 

— 2.4 ~ 9.8 .\ 10.1 77.2 

2.5 2.6 ■;..65 5.4 \6.3 81.6 
2.y 1.7 ;76 ' ■ 7.l' sV 7.6 
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much more than at the other schools. Instruction at this school was focused 

i , 

on objectives 06, 07, and 10 to which 80% of the time was allocated. At 
three other schools, different objectives were emphasized in addition 
to 06 and 08; at School 440 nearly one-third of the time was allocated 
to Fractions^ Concept (07) with the result that nearly half of the time 
was allocated to fractions; at School 333 nearly one-fourth of the time 
was allocated to geometry and ano ther 18% to miscellaneous top l^is; at 
School 905, Multiplication (05) was the additional general objective 
to which a large proportion of time was allocated^ 29%. At Schools 428 
and . 906 the proportion of time allocated to objectives was never extremely 
large. 

The very small proportion of time allocated to Word Problems (12) and 
Applications (13) is disappointing. These objectives comprise the aggre- 
gate objective Problem Solving which, for most adults, is the primary 
application for mathematics in school. 

Proportion Observed 

The relationship of log allocated time a7?.d observed time is shown in 
Table 11. From 16 to 21 formal observations were made in each fifth 
grade during the 25-week study, representing from 13% to 16% of the allo- 
cated time. In most cases, the instructional emphasis shown in the logs 
was maintained in the observations; that is, a large proportion of the ob-- 
served instruction concerned those objectives to which a large proportion 
of time had. been allocated. 



lable 11 . 

Relationship of Allocated Time and Observed Time by Objective . 



Observations General ObJe,ctlve 



Total Z of 

SCHOOL CLUSTER No.. Hours Alloc. Time. 04 05 06 07 08 09 10 11 12 13 14 



15 



ICE/DMP 

20 108.80 15 3,4 12,10 18,23 31,28 15,14 0+,- ' 1,— 5,3 3,5 2,2 4,7 6,4 

593 V ?.0 73.92 13 4,- — 27,26 20,34 7,4 2,*- 33,29 7,6 V 

ICE/non-DMP 

^28 T 17 79.23 . 16 * 1,1 10,6 20,34 22,24 10,4 3,5 8,3 4,— 4,- 1,- 5,-11,12 

"3 P " ".09 13 8,12 15,16 7.2 21,18 ^-,2 4,4 6.5 23,25 18,16' 

non-IGE/DMP 

- 21 70.18 15 1,« 29,33 19,27 11.13 26,20 0+,— 3,4 — ,— 5,.- 5,3 1,-1 

- 20 99.00 15 2,0+ 21,27 . 24,17 15,21 17,10 5.3 2,5 8.11 2,3 1,3 2,1 2,0+ 



NOTE: For each general objective, the proportion of allocated time la given first, followed by the proportion of observed avail- 
able tlme« 
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Nonapplied Tiine> Available Time, and Engaged Tim e 

Formal observations were made during the time period in which inathema- 
tics instruction was scheduled in each school. Data on time use were developed 
from these observations. Briefly, the time u6e variables are as follows: 
nonapplied time, the portion scheduled for but not devoted to mathematics 
instruction; available time, the difference between scheduled observed 
time and nonapplied time; engaged time, the portion of available tlrae 
that students were observed to be attending to instructional activities. 
(These variables are described in more detail in Chapter II.) 

As shown in Table 12, the percentage of nonapplied time, and of course 
available time, did not vary greatly among schools. The largest percentage 
of nonapplied time was observed at the two, IGE/DMP schools which were similar 
to each other. The non-IGE/DMP schools also were similar. No other similari- 
ties in nonapplied lime occurred — label groups or cluster groups. The smallest 
percentage was noted at Schor" 3, which had a consistently large percentage 
of available time across inst:* ^nai periods. 

. Variability among schools increased for engaged time. The label 
group of IGE/non-DMP schools were similar to one another and had a 
higher average engagement rate than the other label groups. The pair of 
Schools 593 and 333 were similar, and had a high engagement rate. Schools 
^40 and 428 from the triplet had the lowest and highest engagement rates 
respectively. At School 593, the engagement rate was most consistent 
across instructional periods; it was sufficiently high that the 
second highest percentage of aisgaged tinye was observed there, even though 
the percentage of available timci hac Uecn l^- yest.. 
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Table 12 

Nonapplied Time, Available Time, and Engaged Time 
as a Percentage of Observed Allocated Time, Grade 2 



SCHOOL 



IGE/DMP 
440 
593 
Mean 

IGE/non-DMP 
4 28 \ 
333 
Mean 



Available Time 



CLUSTER 



Nonapplied 
Time 



/ 



T 

P 



T 
P 



8 
10 
9 



5 
2 
4 



Total 
Study 



92 
90 
91 



95 
98 
97 



Range for 
Periods A-G 



83-99 
87-96 



77-99 
96-100 



Engaged ,Time 



Total 
Study 



Range for • 
Periods A-G 



56 
75 
66 



78 
74 
76 



49-66 
70-80 



63-85 
66-82 



non-IGE/DMP 
905 
906 
Mean 

Triplet mean 
Pair mean " 
Grand mean 
Standard deviation 



4 
6 
5 

7 
6 
6 
3 



96 
94 

95 

\ 

94 
94 
94 
3 



90-99 
89-99 



72 
64 
68 

67 
75 
70 
8 



69-80 
51-74 



NOTE:^^ Available time and engaged time are shown separately for each instructional 
period in appertdix Table M5LTU. Nonapplied time is broken down bv type in 
appendix Table M5NAPT. " ' \ 

,- - , . .94 ■ . 
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/The allocated hours of instruction from Table 10 and the overall 
percentage of engaged time from Table 12 together permit estimation 
of fhe average weekly engaged time for each child (Table 13) . There 
, was less variability among. schools in engaged time than ii^ allocated time. 
\ The IGE/DMP schools had the extremes in allocates; '>ours and the 
lowest average engaged hours, only slightly below tJ - ... IGE/DMP schools. 
Jhe IGE/non-DMP schools were average in allocated ti.ue -md^superior to the/ 
jDMP; schools in engaged hours. 

i • \ 
Means of Instruction 

.' ' \ ' ' ' 

, The IGE Instructional Programming Model provides for the use of /a 

; variety of group sizes and of instructional materials to meet children's' 
j individual instructional needs. Developing Mathematical Processes was 
(developed consistent with the IGE philosophy; in addition DMP was based 
■ ori the belief that children best learn and apply mathematical i'deas by 
[working with physical matei^ials. Thus, all schools were expected to use 
|a variety of group sizes and materials, with DMP schools using manipulative 
I to a greater extent than non-DMP schools. Student interactions should 
[increase with increased use of small groups. 

Use of the three group sizes and the three primary types of materials 
and incidence of teacher and student interactions are summarized in 



Table ,1.4, In use of the three group, sizes the two nori-IGE/DMP schools 
are similar to each ot^er and different from the othZ two label groups; 
tanly in use of small groups,, however, is there no overlap in the range of 
.'•indivlduaL school scores." The IGE/DMP schools ha^a much higher rate of 
teacher interactions than the other two groups. /The pair, Schools 593 
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Estimated Hours Allocated and Engaged for Each 






Child Each Week 


, Grade 5 








I ' Hours 
\ per 


allocated 
child 


Engaged time 


SCHOOL 


Total 
CLUSTER studv^ 


Per week 


Ptf> "T* P P ri f'H 


Estimated 
nourd / weeK 


IGE/DMP 










440 


T 90.9 


3.6 


DO 


z.O 


593 


P 69.3 


2.8 

/ 




z • 1 


Mean 


> 80.1 


; ^ m Jim 

i 


00 


0 1 


IGE/non-DMP 




1 

i - • 






428 


T 82.2 


3.3 


78 


c ■ 

2,6 


333 


P 85.1 . 


3.4 


7h 


2»5 


Mean 


7 

o ^ . / 




/o. 


2.^6 


non- IGE/DMP 










905 


76 ..9 


' 3.1 


72 


2,2 


906, 


85.2 


3.4 




2.2 


Mean 


81.1 


3.3 


68 


2.2 


Triplet mean 


86.6 


3.5 


67 


2.3 


Pair meAn 


, ■ _ / 77.2 


3I1 


75 


2.3 


Grand mean 


81; 6 


3.3 


70 


'2.3 


Standard deviation .7.6. 


.3 

J 

■/ 


8 . 





^Frora Table 10. 
^From Table X2. 



• . Table 14 

Instructional Process Variables as. a Percentage of Available Time, Grade 5 



Group Sizes^ Materials^ Interactionsb 



Paper & 

CLUSTER Individual Small Large.; Pencil 'Manlpulatives Print Teacher Student 



T 


66 


J 


j\j 






A 

9 


18 


4 


. P 


38 


0 


62 


. 80 




61 


31 


9 




52 


3 


46 


'85 


■ 5 


35 


25 


7 


-DMP 


















T 


51 


3 


46 


90 




50 


. 14 


11 ■ 


P. 


99 


1 


0 


98 


0 


25 


1 


7 




75 


2 


23 


94 


2 


38 


8 


9 


'DMP 




















80 


10 


11 


87 


2 


- 67 


~ 7 


8 




75 


16 


9 


96 


12 


55 


7 


10 




78 


13 


. 10 


92 


7 


61 


7 ' 


9" 


mean 


59 


4 


' '38 


90 


7 


30 , 


16 


8 




69 


1 


■ 31 


89 


" 0 


43 


16 


8 


an 


68.17 


5.83 


26.33 


90.00 


4.67 


44.30. 


13.00 


8.17 


deviation 


.21.66- 


6.11 


24.09 


, 6.48 : ■ 


5.16 


22.63 


10.64 


2.48 



s may not sum to 100 due to rounding, 
s need not sum to 100. 



80 



and 333 were alike in their nonuse of manipulatives. Overall, there 
is no pattern of instruction that can be attributed to labels or to the 
cluster groups. 

As noted above, at both non-IGE/DMP schools small groups were ob- 
served more than at other schools. At Schools 440 and 906, both DMP 
schools, manipulatives were used more than at other schools.^ Even at 
these schools, small groups and manipulatives were used less than expected. 

Individual work was dominant in all schools except School 593; at 
School 333 it was essentially the oiay instructional group. These ,t^ 
schools, were also the extremes in use of large groups , with School 593 
using large groups 62% of the time and School 333 never using large: groups. 

Paper and pencil materials were in use nearly constantly in all schools 
manipulatives7 as noted above, were used little if at all. In materials 
use school showed the greatest variability in use of print materials, 
ranging from less than 10% of the time at School 440 to nearly 70% at 
School 905. V 

At School 593, teacher interactions were observed nearly one-third 
of the time,- more than the total interactions observed at any other 
school. School 333 was quietest, with interactions observed only 8% 
of the time. There was greater variability in the proportion of teacher . 
interactions than student . 
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\ Achievement Results^ 

■ \--::' ■ ■ : . . 

All general objectives and aggregate objectives were identified 

■" ' ^ 

in Table 2. Those represented in the achievement monitoring tests are 
lasted xn Table IS^^along with the number of items contributing to 
the score for each general objective and aggregate. Scores are reported 
as proportions of actual number of correct responses to possible 
number of correct responses. For aggregate objectives, scores are 
weighted averages of the scores for contributing objectives. For 
example, the score for 16, Place Value and Numeration, is the.^s^^^ 
.8 of the score for Writing Numbers (01) and .2 of the score for 

Inequalities (02). For 20, Problem Solving^ the score is the sum 

\ 

of .6 of the score for Word Problems (12) and .4 of the score for 
Applications (13). \ n, 

Grade 2 

Results are shown in Table 16 whichXincludes, for each objective, 
scores at times 1 and 8 and residual gain score. Mean scores are reported 
for label groups, for cluster groups and forvall schools combined. 
Information about test results at all eight test times is provided by 
Wabb and Nerenz (1980b) . \^ V > > 

: At lx5th test times 1 and 8, average scores for Writing Numbers (01) 

^ \ \ ^' ' 

and tor Measurement (11) Vere^ high; averages for Word Problems (12) were 

\ ' \ ^ ^ ^ - . .\ 

consistently "^low. Only for Writing Numbers was the average above .50 
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Table 15 

Number of Items Contributing to Achievement Scores 
for the IGE/DMP Comparative Study 



Number of Items 



General Objective 



Grade 2 



01 Wr 



Trlting 



Numbers 



02 Inequalities 

16 Place Value and Numeration 

04 Addition/Subtraction 

05 Multiplication \ 

06 Division \ 

17 Operations (Whole Numbers) 

07 Fractions Concept 

08 Fractions Computes 

18 Fractions 

09 Decimal Concept 

10 Decimal Computes 

19 Decimal Fractions 

11 Measurement 

12 Word Problems 

13 Applications 

'20 Problem Solving 



16 
4 

20 

20 

20 
8 

8 



12 
8 

20 



Grade 5 



4 
12 
8 

24 

12 
8 

20 

4 
12 

16 



8 
8 

16 
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Table 16 I * : 
Achievement Results for the Grade 2 Schools 



Objective 01 



Objective 02 



Objective 16 



Objective 04/ir 



Objective 07/18 



ICHOOL 


CLUSTER 


1 


8 


Change 


Real- 
dual 


1 


3 


change 


Real- 
auax 


1 


0 
0 


Change 


Resi- 
dual 


1 


8 


Change 


Resl- 
1 dual 


1 


8 


Change 


Resi- 
dual 


.GE/DMP 














































T . 


,49 


.78 


+.29 




9 A 


.3/ 


+.33 


-.06 


.44 


.74 


+.30 , 


+.07 


.32 


.44 


+.12 


-.08 


.34 


,54 


+.20. 


+,02 . 


593 


P 


.58 


;87 


+.29 


+.07 


.40 


.84 


+.44 


+.14 


. 54 


.86 


+. 32 


+ ft? 




711 


+. Jo 


-LI/ 
+ .l«l 


.51 


,56 


+,05 


-.00 


Mean 




.54 


.83 


+.29 




.32 


'.70 


+.38 




; . 49 


.80 


+.31 




..36 


.61 


+.25 




.42 


,55 


+,13 




CE/non-DMP 












































m 


T 


.48 


.71 


+.23 


+.01 


.31 


.60 


+.29 


-.06 ' 




.69 


+.24 


+.01 


.32 


.46 


+.14 - 


-.06 


.41; 


,41 


.00 


-,13 


421 




.49 


.71 


+.22 


-.00 


.43 


.78 


+.35 


+.06 


.48 


.72 


+.28 


+.00 


.35 


•53 


+.18 


-.04 


.59 


,67 


+,08 


+.08 


333 


P 


.62 


.77 


+.15 


-.07 


.36 


.79 


+.43 


+.10.. 


.57 


.77. 


+.20 


-.06 


.43 


.61 


+.18 


. -.08 


,52 


,53 


+,01 : 


-.04 


Mean 




.53 


.73 


+.20 




.37 


.72 


+.35 




.50 


.73 


+.23 • 




.37 


.53 


+.16 ' 




.51 


,54 


+.03 . 




on-ltE/DMP 












































904 




.51 


.73 


+.22 


-.00 


.41 


.72 


+.31 


+.01 


.49 


.73 


+.24 


-•00 


..31 


.54 


+.23 


+.04 


•.30 


,60 


+.30 


+.09 


906 




.62 


.84 


+;22 


+»00 


. -27 


.73 


+.46 


+.08 


.55 


.82 


+.27 


+.01 


.37' 


.63 


+.26 


+.03 


.38 


.59 


+.21 


+,06 


762 


T 


.45 


.60 


+.15 


-.07 


.41 


.44 


+.03 


-.27 


.44 


.57 


+.13 


-.10 


.24 


.44 


+.20 


+.04 . 


,38 


,43 


+,05 


-.10 


Mean 




.53 


.72 


+.19 




.36 


.63' 


+.27 




.49 


.71 


+.22 




.31 


.54 


+.23 




.35 


,54 


+.19 




triplet mean 




.47 


.70 


+.23 




-.32 


.54 


+.22 




.44 


.67 


+.23 




.29 


.45 


-K16 




.38 


,46 


+.08 




ilr mean 




.60 


.82- 


+.22 




.38 


.82 


+.44 




.56 


'.82 


+.26 




.42 


.70 


+.28 




.52 


,54 


+.02 




rand mean 




.53 


.75 . 


+»22 




.35 


.68 


+.33 




.50 


.74 


+.24 




.34 , 


.55 


+.21 






.54 


+.09 




landard deviation 




.07 


.08 






.07 


.14 






.05 


.09 






.06 


.12 






ilO 


,09 







102 



103 




ERIC 



















































,\ 






















-. i . ■ ■ ■ ',1 
.. . .,.« 














Table 16 


V continued; 


























Objec 


tlve 11 






Objec 


tlve 12 






Objective 13 






Objective 20 














Resi- 








Resi- 








Resi- 










SCHOOL 


CLUSTER 


1 


8 


Change 


dual 


1 


8 


Change 


dual 


1 


8 


Change 


dual 


1 


8 


Change 


dual 


IGE/DMP 




































■ ^^0 


T 


.56 


.57 


+.01 


-.16 


.26 


.48 


+. 22 


T. i J 




.46 

t 


+.10. 


—.00 


.30 




+. 17 


+iio> 




P 


♦ 56 


. 75 


+• 19 


+»03 


.46 


.71 


+.25 


+.05 


.28 


.62 


+.34 


+.23 


.39 


.67 


+.28 


+.ioi 


^, Mean 




.56 


.66 


+.10 




.36 


.60 


+.24 




.32 


.54 


■+.'22 ■;. 




.35 


.57 


+.22 




IGE/non-DMP 








































.88 


.97 


+.09 


+.15 


.31 


•^3 


+.12 


+.00 


.28 


.40 


+ .12 ; 


+ .01 


.30 


.42 


+ll2 


+.05 


; 421 




.25 


• 88 


+.53 


+.23 


.33 


.48 


+.15 


+.02 


.46 


.65 


+.19 


+.10 


.38 


.55 


+.15 


. +.00 


V-333 ■" ' 


P 


.70 


.83 


+.13 


+.06 


.34 


.49 


+.15 


+i01 


.43 


.44 


+.01 


-.08 


.38 


.47. 


+.09 


-.08^ 


. Mean 




.61 


.89 


+.28 




.33 


.47 


+.14 . ■ 




.39 


.50 


+.11 




.35 


.48 


+.13 


i 


non-IGE/DMP 








































.11 


.80 


+.69 


+.19 


.28 


.33 


+.05 


-.05 


v44 




+.10 . 


+ .01 


•34 


.41 


+.07 


-.05 


, 906 




.Jo 


. JZ 


uo 




.32 


.47 


+.15 


+.02 


.36 


.30 


-.06 


-•16 


;34 


.40 


+.06 


-.06;^ 




. T . - 


.28 


..53 


+.25 


. ^.13 


.33 


.28 


r.05 


-.18 


.'22 


.24 


+.02 


-.10 


.29 


.26 


-.03 


-.08- 


^^: Mean . 




.26 


.55 


+.29 




.31 


.36 


+.05 




.34 


.36 


+.02 




.32 


.36 


+.04 


f 


Triplet mean 




.57 


.69 


+.12 




.30 


.40 


+.10 ■ 




.29 


.37 


+.08 




.30 


.38 


+.08 ' 


■ ■•-■s- 


Pair mean 




.63 


■79 


+.16 




.40 


.60 


+.20. 




.36 


-53; 


+.17 




.39 


.57 


+.19 




Grand mean _ 




•^7 


//I 


+.24 




.33 


.46 


+.13 




.35 


.46 


+.11 




.34 


.46 


+.22 




Standard deviation 




.26 


.22 






.06 


.13 






.09 


.14 






.04 


.12 
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at test time 8. The smallest average gain, .09, was on Fractions 
(07); the largest, .33, on Inequalities. 

In general, there was little variance for scores at test time 1 
and greater variance at test time 8; variance did^ not change for 
objectives 01 and 07. On objective 11, Measurement, schools differed 
greatly at test time 1 and only slightly, less at test time 13. 

Scores fox the pair of schobls were consistently higher than the 
average and higher than scores for the triplet of schools. The triplet 
averaged below the mean except on objective 11, Measurement. The three 
nonrlGE schools usually scored lowest of the label groups while the 
two groups of IGE schools alternately had the highest average. 

In three schools — 593, 421, and 904 — residual gains were more 
positive than negative. School 593 residuals were consistently positive 
with a very^ large residuals for Applications (13) , indicated as very 
effective mathematics instructional program. School 421 had only one 
negative residual,* -.04 for Add it ion/ Subtract ion (04) and a large 
positive residual for Measurement (11). School 904 also had only one 
negative residual, -.05 for Word Problems. ^(12) and also a large positive 
residual for Measurement . Schools 440, 428, and 333, Jiad a mix of positive 
and negative residuals, more negative than positive. School 906 also 
had a mix, but the large negative residual : for Measurement, -.37, yielded 
a bad overall record. School 762 had only one, positive residual, -.04^ J ^^^^^ 
for Addition/ Subtract ion, suggesting that mathematics instruction at that, ; 
school is ineffective. 
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Grade 5 s 

Results are shown in Table 17 which includies, for each objective, 
scores at times 1 and 8 and residual gain score. Mean scores are re- 
..ported for label groups, for cluster groups, and for all schools coiibined. 
Although only two of the schools in the triplet participatejj-^^ Grade 5,. 
Schools 440 and 428, the T designation is still used^ Results for all 
eight test times are provided by Webb and Nerep,z''^^980b) . ^ 

The most striking finding is the sligm: but consistent decline on 
Addition/Subtraction (04); only Schdol 428 had a higher average at time 8 
than at time 1. At both times 1 and 8, scores were, highest for this 
objective. Scores were. high at both times 1 and 8 for Mul tiplicatipn (05) 
By time 8 the average score was above ,50 for four additional ^objectives: 
Division (06), Fraction Concepts (07) , Decimal Fraction Computing (10), 
and Word Problems (12) . For the other three objectives— Fractions 
Computing (08), Decimal ^Concept (09), and Applications (13) — the average 
scores were low at time 1 and did not increase to a high level by time 8; 
however, the average gain for Fractions Computing (08) of .15 was greater 
than most. 

There was generally little variance in scores at either time 1 or 
time 8 and, as a result, little change in variance between test times 
for most objectives. Variance decreased for Multiplication (05) and 
Division (06). and increased for Decimal Computing (10). Ai: Grade 2, 
increased variance a,t time 8 had been typical. 

" Average scores for the pair of schools, from which only two schools • 
participated, were higher than the average and higher than scores for 
the . pair, except for Fractions Concept (07). 



Table 17 

AchlevcmenC Results for Gtade 5 Schools 



Objective 04 



Objective 05 



Objective 06 



CLUSTER 1 



Resl- 
8 Change dual 



Real- Resl- 
1 8 Change dual 1 8 Change dual 



Objective 17 



Objectlytj_07 



Real- Real- 
1 8 Change dual 1 8 Change dual 



.83 
1.00 
.92 

.78 
.92 
.85 



.74 
.96 
.85 



-.09 -.06 
-.04 +.02 
-.07 



.81 +.03 +.05 
.88 -.04 ^+.00 
.84 -.01 



.62 .63 +.01 -.12 
.71 .86 +.15 +.11 
.66 .74 +.08 



.58 .76 +.18 
.79 .73 -.06 
.68 .74 +.06 



+.02 
-.02 



-.31 .48 +.17 -.11 

.37 .82 +.45 +.21 

.34. .65 +.31 

.36 .54 +.18 -.06 

.60 .64. +.04 -.04 

.48 .59 +.11'. 



.55 .60 +.05 -.11 
.66 .86 +.20 , +.12 
.61 .73 +.12 



.54 .70 +.16 
.75 .73 -.02 
.64 .72 +.08 



.01 
.03 



+.2r\/ 




•K06^ 
-.03 



.31 .55 /+.24 +.02 
.40 ,60 +.20 -.01. 
.36 .38 +.22 



905 


.89 


.85 


-.04 


-.00 


.39 


.76 


+.37 


+.02 .11 


.52 


+.41 


-.01 .38 


.70 


+.32 


•*-.04 


.28 


.48 


+.20 


-.02 


906 


.86 


.82 


-.04 


-.00 


.65 


.74 


+.09 


-.01' .36 


.60 


+.24 


-.00 .59 


.71 


+.12 


-.00 


.70 


.85 


+.15 


-.02 


Mean 


.88 


.84 


-.04 




.52 


.75 


+.23 • 


.24 


.56 


+.32 


.49 


.71 


+.22 




.49 


.66 


+.17 




rlplet^mean 


.81 


.78 


-.03 




.60 


'.70 


+.10 


.34 


.51 


+.17 


.55 


.65 • 


+.20 




.41 


.66 


+.25 




air mean 


.96 


.92 


-.04 




.75 


.80 


+.05 


.49 . 


.73 


+.24 


.71 


.80 


+.09 






.59 


+.19 




raad mean 


.88 


.84 . 


-.04 




.62 


.75 


+.13 


i 

.35 


.60 


+.25 


" .58 


.72 


'+.14 




.43 


.64 


+.21 




tandard deviation 


.08 


.07 






.14 


.07 




.16 


.12 




.12. 


.08 • 






.15 


.14 
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Table 17 (continued) 



Objectlve 08 



Objective. 18 



Objective 09 



Objective 10 



- Reel- Real- 
CLUSTER 1 -8 Change dual 1 8 Change dual 



Resl- 

1 8 Change dual 

rh 



.18 .40 
.22 .29 
.20 .34 



+.22 +.07 
+.07 -.08 
+.14 



.37 .62 
.33 .46 
.35 .54 



+.25 +.07 
+.13 -.05^ 
+.19 



.23 .42 +.19 +.09 
.36 .43 +.07 +.02 
.30 .42 +.12 



^ 1 
.28 .43"" +.15 1.03 
I54 .84 +.30 " +.15 
.41 .64 +.23 y -r 



T 


.11 


-.33 


+.22 


+.06 


.23 


.46 


+.23 


+.04' 


^ .25 


.23 


-.02 


-.11 


.44 


.59 


+.15 : 


-.01 


P 


.19 


.23 


+,04 


-.11 


.32 


.45 


+.11 


-.05 


.33 


.39 


+.06 


-.00 


.47 


.47 


+.00 


-.16 




.15 


.28 


+.13 




.28 


.46 


+.18 




.29 


.31 


+.02 




.46 


.53 


+.07 , 


































/ 

/ 






.11 


.26 


+.15 


-.01 


.21 


.39 


+.18 : 


-.01 


.11 


.26 


+.15 


+.00 




'Xm 


-.07 




.32 


.51 


+.19 


+.06 


.55 


.71 


• +^6 


-.00 


.28 


.36 


+.08 


-.00 


.23 


.54^ 


+.31 


+.12 ' 




;^ .22 


.38 


+.16 




.38 


.55 


+.17 




.20 


.31 


+.11 






/48 


+.21 


V 




.15 


.37 


+.22 




.30 


.54 


+.24 




.24 


.33 


+.11 






.51 


+.15 






.21 


• .26 


;+.05 




.33 


.46 


+.13 




.35 


.41 


+.08 




- ,51 


.66" 


+.15 






a9 


.34 


+.15 




.34 


.52 


, +.18 




.26 


.35 


+.09 






.55 


+.17 






'.08 


.10 






.12 


.12 






.09 


.08 






.12 


.16 




• 



Objective 19 



Rcsl- 

8 Change dual 



Resi-' 

1 8 Change dual /// 

7 '^^ ^ ' 



.27 .43 +.16j3 .'.00?5. " 

.50 .n -+.2«'';|+.i;2.;:;^;C 

.39^ .5o\;.u?i.(;ift,?y' 

.44 .45/jV:01,>tl2t,^;-'|' 




.33 .47 1 +.14 



.26 .38 +.12 ?-i05:^,J±' 
.24 ,50 .+.26.^+'.09 ^V^^-^' 
.25 .44 +.19^ 

.47 -.60 '+.13 ^'^^l ' 

.35 .50^>.i5 ' A v,'. 

.11 .13 / ^ ^ . ^h. 




Table 17 ; (continued) 



^SCHOOL- ■ 



Objective 12^ 



Objective li3y: -; 



Objective 20 



CLUSTER ■ ' . . 1;^ '-- 8 ■,:-Charige:v;^dualv-: -;.. : l ■;;^V;,8^;':;/^^■Cha^^ 



8 Change 



'Resif-^g, 
; diiai'M?*^ 



||S;:440' • ■ .■ , ■ 

l|y^?593' "-- .'; * 

pSV^ ■■■■ 
^CE/non-DMP . 

pg^^^Kcan . ■.. 
ISan-IGE/DMP 

88?^^- * •■ 

^^rkean ■ 
^Triplet mean . ' 
^jPair, mean • . 
^RGrand mean 
:f^\Standard deviation 



.39 
.50 
.44 

.28 
.48 
.38 

.^3 
.58 
.50 

*34 

.49 

.44 

.10 



.51 
.55 
.53 

.38 
.54 
.46 

.42 
.63 
.52 

.45 

.55 

.51 

.09 



+.12 . +.05, 

+.05 -.00 
+.09 

+.10 +.01 

+.06 +.01 
+.08 



-.01 
+.05 
+.02 

+.11 

+.06 

+.07 



-.07 
+.02 



.17 

.23: 
.20 

.20 
.23 
.22 

.07 
.15 
.11 

.19 

.23 

.18 

.06 



.23 
.26 
.24 

;27 
.27 
.27 

.17 
.31 
.24 

.25 

.27 

.25 

.05 



+.06 -.02 
+.03 ; -.02 

:"+!^b4j.^-'-.," 

4,07 +.01 

+i:b4 v -.01 

+.05 



,+-10 
+.16 
+.13 

+.04 
+.07 



;.-.o^. 
; +.07 



.28^ 

.37 

.33 

.24 
.36 
.30 

.25 
.37 
.31 

.26 

.37^ 

.31 

.06 



.39 

.41; 
.40, 

.33 
.41 
.37 

.30 
.47 
.39 

.36. 

.41 

.39 

.06 



+.11 
+.04 

+;d7 

+:o9;^ 

+ip5 
+.05 

;:+i.io : 

+^08 
+;10 i 
+.04 
+.08 




m 
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Average scores for the pair of schools; were higher, than the oyer^ 
averages and higher than scores for, the triplet except for Fratct to 
Concept (07) and its aggregate (18). The triplet, averaged "below the /-^.V 
^^grand mean on all pbj ect ives except Applications (13) . At Grade 2 , ' ; 
the pair of schools had consistently averaged above the grand mean 
and above the average for the triplet. ^^^^^^^ -^^^^^^^^^^ ^^^^^^^^^ ; 

The IGE/DMP schools had the highest average .on six of .the nine 
general objectives and three of the four aggregate object ivesv to 
Multiplication (05) and Fraction Computing (08) , the npn-IGE/DMP; schools:^ 
averaged highest on Applications (13) . V Diff ererices^ainonght 
groups: , schools were small "except for Decimal Coinputing '^(10) and 
its aggregate (1 9) . At '■ Grade 2 , t he non-IQE schoblsf had hkdv the lowesi^???| 
averages; School 762, which did not participate in the; Grade 5 study, 
was the low scoring member of that Grade 2 label group;^ : 

Only Schools 593 and 906 had more positive than n^^ 
mean gain scores overall. The Grade 2 results; ^or Schboi?^593>^ 
consistently positive, while School 906 had predominantly negative 
results. At School 493 instruction was particularly effective f^r - 
the general objectives contributing to aggregates for Operationis (17) < 
andDecimal Fractions (19). Schools 333 and 905 h 
consistently negat ive residuals . Instruction at School 333 i which 
had only two very small positive residuals appears particularly ; 
ineffective. 
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Predictive Results 



In this chapter, results for each of the four aggregate objectives 7^^^^^^^ 
in mathematics are discussed in rela,tion to ; tJine and means of Instruc-^^^^^^^^^^r^^^^^ 
tlon« The emphasis is on identifying; lnstructlonal> patterns that are -'^'i-r-y^hyi-^ 
particularly effective in raising children's achievemejit.'y^ ;^^^^ . ^ ^ ^ ^^^^^ 
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ihools ; H'&i>^'" ^ 



On Objective 16, Place Value and Numeration, students In 
440, 593, and 90& made above average achievement :galhs ( Tablet 18) • ' / 
Students were observed to be engaged more hours at thes|e;:three schobli3'^^^^^^^^^ 
than at the other five. Hours engaged reflects the emphasis on this ob--> • ' 
jectlve at School 440, where over one-third of the mathemi^ 
":time was allocated to place value and numeration. Although only halfv^M^ 
"much of the mathematics time was, allocated, to this: objective at VScihpbi^ 
593 and 906 , the high emphasis on mathematics ' at these ■ schools indicated- ^^^f^^^^^^^^^^ 



by the estimated hours of mathematics: instruction each^week^^^^^^^ 



large number of hours of instruction on this objective ^^' A^ 
three schools showed' no: distinctive*' pattern ,of instruction. i^^^f^^^^^^^^^ 

Although addition,, ^ subtraction,: and: multiplicatlbi^^^^ f or"'^;i;I|:^ 

instruction in Objective 17, Operations, only; addition: and' s 

tested and very lit tle was allocated to multiplication at * any^ of the schools^^^^^ 
(see Table 5). At most schools, addition and subtraction. of whole ^ number s', "^'--^i 

is the primary focus of the second-grade mathematics curriculum; only: at^^^^^^^^^r^^^^^^ 
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Data Svnanary for Cujectlve 16, Place Value and Numeration,' ^ 2 







Demog- 


Use of Uae of 2st. 


Hours ■ X ^ 


/Engaged. ; 


^ '^Groupii^ ^'^^ , . . Materials .Interactions 


'^Achievenent'^VgJ.*:^^ 


SCHOOL 


raphy 


DMP . IPM hrsM 


alloc, alloc. 




; Indlv, , ' Small^Xg. , :vPop.. Manip.- - Print ^Stud^;Tchr^:;); 





IGE/DHP 





.-;";2 ; 


9.00 


52.75 


2.4 


163.4 


34 


13.33 


71 : 


; 8i58 : 


'■:'-l-.86'; 


::8;^r 


593 


6 


10.00 


•39.00 


3.7 


121.6 


16 


10.59 


-77"-^ 


9.90' 




i;3'15.. 


IGE/non-DMP 
























428 ; ; 


?2"-. ; 


0.00 


71.75 


:1.9 


42,7 


15 


■ 6.03.; 


84 :; 


.'■4.'50\ 


-.'.■>.i2; 


j^2;54'' 


^21 




.0.00 


80.00 


2.2 


3.3 


. 1 


'vi.84 




;V'3.87j'-' 


. y.;:;oo 


.68 


333 


6 


"0.00 • 


58.00 


1.6 


12.5 




/■■■2.53-: 


;90 


.:2,.62 




.pas! 


non-IGE/DMP 
























; 904 ; 


-2 . 


9.00 


46.00 ' 


2.0- 


.48.6 


16 : 


.■#5!70"' 


;;52 


;4.85; 




5[b7- 


906 


5' 


8.40^ 




3.7. 


93.0 


^17V:' 


17. 70' 




:7.09' ; 


•6^9 11,25: 


762 


1 


10.00 


77.00 '^ : 






.12 . 


6.25; 


5S 


;8.91;; 


;.00 


;;i:87;: 


Mean ; 


3.63 : 


5.71 




2.5 


72.0 


14.4 


8.01 


68 


6.29;': 


; 1U5 


=4.23' 


Standard 
'deviation 


2.07. 


4.78 ; 






55.1 


9.9 


5.49 


16.8 


2.68 ■ 


2.21 


:3-9i 


^Average of scores for DMP use at 5 other DMP schools. 



•':bbV;':7r-'' 4i80 ' 



71;;';'^V18 ;.;\;?^|^3^;.;|§^^ 
q4:!.:v/^'-00;;-;;^^^ 
i3-:.';;.^:;oo>'.v-^2:3^ 

^ 5:87- ,y9.91 .N:2*00;; l7:93»;;^v^C60;: -i. 
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schools 440 and 906 was less than 40%^of-^the mathematics- 
time allocated to operations. Initial scores^were -above average at 
School 593 as well as at Schools 421, 333, and^^06 (Table 19) . At 
Schools 593 and 906, ac:hievemeat gains were above average; a 
and 333, below. At Schools 421 and 333, students worked^^dividually 
over 80% of tha t:(jaft. Individual work occurred a smaller pro^ort^i^on^^ ^^-^ 
of the observed time at Schools 593 and 906 where large groups were^mc^re 
frequent3.y observed. -At School 906, extensive use elf small groups was 
also observed. Paper-and-pencil materials, worksheets, were in use about 
half the time at Schools 593 and 521 and nearly 90% of the time at" 
Schools 333 and 906; both Schools 593 and 906 used additional materials-- 
primarily printed materials at School 593, and entirely manipulatives at 
School 906-"^f or nearly the same amount- of. time worksheets were in use. 
In addition, there were more interactions* at Schools 593 :and^906^^^ ^^^^ v 

Instruction in fraction concepts were observed at only six of the 
eight schools; at none of these schools was the number of hours large. 
Qily a small proportion of the allocated time was scheduled for Objective 
IB, Fractions. These data are insufficient for detailed disucssion. 
Note, however, that the two schools in which students made substantial ^ 
gains. Schools 440 and 904, were the two- in which maniptijatives w^^ 
use for a large proportion of the available time (Table 20). 

Only in the five DMP schools was a substantial p 
formally allocated to Objective 20, Problem Solving, and only in those 
schools were instruction in problem solving observedv^^^ T^^ 
gains at Schools 428, 421, and 333 suggesjt that problem solving is an" 



SCHOOL 



IGE/DMP 

IGE/non-DMP 

||421:f:"-" 

033i;'.- .■ 

nion-IGE/DMP 




Allocated 



Hrs. 



' 97.2 
312.3 



141.1 
206.1 
202.5 



130.8 
158.3 
295.4 



20 
42 



50 
68 

;44 
29 
40 



mm 



Data Summary iEor Objective 17 Operations, Grade' 2 v^ r^^^ 




Engaged 



Grouping 



Materials.; 



: Interactions 



:' Achievement'";-;^?^ 



Indlv . Sm^ll ; Lg . V Pop . Manijp . 



Print V ^. Stud 1^: " Tchr. 



ch: 



Resi 



11.44 
46.50 



13.93 
13.09 
30.05 

17; 56 
13.08 
31.44 



66 
71 



82 
59 
74 

76 
64 
65 



6.24 
41.47 



12.91 
.17.91 
36.35 



21.13 

' ■;;'.6;- 55 i' 
34.84 



2.16. 
6.09 

70.;. 

;U95 
2^09 

.: ■j.-J'C;'; 

.■J'^16':' 
4.79 



.9.05 
17.59 



13.60 
34.96 



'-3;2lV"l4;8r; 
1. 86 11.11\ 
J2:29 7 35.80 

1.81;; 21.59 
9.22 /V 18.03 



2/22 : 11.34 ; : 44.65; 



230.5 42.3i: 21.14 69.6 22.18 '2.52 v 7.07 ; 24.32 



Standard deviation 165.7 14.2 12.59 7.5 13.82 1.98 5.71 12.45 



7 . 64^^ ' "^^^ 3^74 . 32 
4 .2? 21 ; op • l';^^ ■ ■ • ^0 • 

■■.'l.ii' . 32'- 

2 ;73 ^^.i ] : ba^QW^o^^ 9p>^ ".' . is-. 

. 11 ' 15 .^^3 3-87 * 'J .2.07"7^ 443^ 

/ ,/.06t;,. -6.33 >:.89i\-\;lll6 .31'.; 

■^■9'.05'^^')^^^^^^ ^ 24 ^ 

^•■::5:3^' j;;V5\42V^:S^ .34". 

• V'5.63->'^"8;4Q' •^::v;^^^ ' ' ,.06^ 



.44 +;i2;v 




.78 -h.ZSvM^:! 



.53:'>-18^-^S^#P 
.61- w'+i^lB^r^^;; 5?p 




'\54-"+;23|?ffi^b 
;4Vvv+.2q;;§^gSp 



.55;. t.2lMvgg 
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■ ■ " • Table 20 ' , ^ 

Data Summary for Objective 18, Fractions, Grade 2 



Allocated 



Engaged 



Grouping 



Materials 



Interactions 



Achievement ' 



^SCHOOL 


Hrs. 


X 


Hrs. 


X 


Indlv. 


Small 


Lg. 


Pop. 


Hanlp.'^ 


Print ^ 


/Stud. 


Tchr. 


flGE/DMP \ 


























|^;44o-' ^ 


5.8 


1 


.87 


79 


.75 


,06 


.29 


1.10 


.87 


.00 


.06 


.29 




12.6 


2 


3.53 


65 


4.92 


.25 


.29 


4.83 


.07 


5.00 


.06 


.00 


!lGE/non-DMP 


























:?;;t428; ■ 


2.7 


1 






















i|42i ' ; . ■ ■ 


32.6 


7 


1.48 




1.52 


1.30 


.44 


2.26 


.38 


.00 


.18 


1.23 


|:|333 ■; ./ 


14.0 


5 


2.26 


77 




.00 


1.75 


1.13 


.00 


2.93 


.00 


1.23 


Jnoiv-IGE/D>^ 


























i|:904 


0.0 


0 


6.17 


77 


5; 39 


.32 


2.33 


3.39 


3.91 


.00. 


.56 


1.00 




58.0 


11 






















K762-- 

■ ■■ - ■ 


99.5 


14 


2.36 


66 


.15 


.00 


3.44 


3.35 


.50 


.00 


.00 


.96 


Hean (6 schools) 


27.41 


4.83 


2.78 


68.17 


1.45 


.32 


1.42 


2.68 


.96 


1.S2. 


.14 


.79 


:Standard deviation 


36.99 


5.19 


1.89 


12.84 


1.79 


.50 


1.31 


f.46 


.1.48 


2.15 


. -21 


.52 


.Mean (8 schools) 


27.87^ 


5.00 






















Standard deviation 


36.60 


5.02 























"Ch. 



Read 



.34 
.5i 



.41 

.59' 
.52 

.30 
.38 
.38 

.44 
,12 

.43' 
ilO 



.54 +.20,. .+.C 

.56 +.05 r'.O 

.41 .+.00 i i 

.67 +.08/ V H^O 
.53 +.01 -^^T-<D 

.60 +.30f^^'A+-'0 
.59' +.21 



.43 +.05- 

.56 V.12 
.08 

.54 +.11 
.09 
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Data Summary for Objective 20, Problem Solving, Grade 2 



Allocated Engaged 



Grouping 



Materials 



Interactions 



SCHOOL 


Hrs. 


Z 


Hrs.. 


% 


Indlv. 


Small 


Lg. 


Top". 


r Manlp. 


Print 


Stud. 


Tchr. 


1 . 


fIGE/DMP 




























/ 440 


121.3 


25 


6.22 


64 


2.98 


2.01 


4.65 


8,05 


4,89 , 


.00 


1.10 


2.16 


.30. 


593 

'i!rv=T .7,; ■ -. - ■ ■ .■ ■ 


149.1 


20 


7.89 


77 


5,18 


.00 


5.12 


3,1A 


: ,00 


7.38 


.58. 


2:00 : 


.39- 


IGE/non-DHP 




























fs428 


7.4 


3 






















.30 




12.7 


3 ' 






















.38^ 


'^333 

r^^ ■. ■•■ . . 


00.0 


0 






















.38 


no'n-IGE/DMP 




























[/904 


62.3 


•20 


13.00 


80 


1.40 . 


■ .17 . 


. 14.65 


15.10 


- .00 * 


• .5.01 


,93; 


3.19 


.34 


5:906 


228.2 


42 


22.57 


66 


13.37 


5.97 


14.66 


27. 8A 


27; 01 


■ 2.83 


5.03 


7.84 


.34 


/ 762 


121.1 


17 


8.31 


68 


5.64 


; .00 


6.53 


11.50 


3,32 


..4l' 


1.27 


^.48 


.29 


Mean (6 schodls) 


136.4 


24.8 


11.60 


71 


5.71 


i.63 


9.12 

r 


13.13 


7.04 


3.13 


1.78 


3^53 


.33 


Standard deviation 


60.29 


10.03 


6.63 


7.07 


4.61 


2.57 


5.10 


9.33 


11.36 


3.12 


1.83 


2.45 


..04 


Mean (8 schools) 


87.76 


16.3 






















.34 


'■'4. 

Standard deviation 

'J 


81.21 


14.06 






















.04 



Achievements \ ' 



8 Vf Ch; 'Resldr^;^ 



•+.i7-:',-:^':rib§^ 
.6,7^ .+.28;.":^+.;ipj^ 

. .42''-+;i2;'^^+^Pj5j 

-.55^ +.i7.\^^|;|;t^^^ 
:05:^ 



.03 <^M\^m 



.41' ■;+.07 
>;4p +.06 
:26 

.44 +.11 

.15 

:46 .+.12 
■.12' ' 



Integral part of instruction on o the t mathematics of objectives (Table 21) 
Achievement gains were low for all three non-IGE/J)MP schools i particularly: 
so in School 906 where over 50% of the mathematics instructional time was' 
allocated to problem solving. The instructional pattern in this school 
was not different from the effective patterns at Schools 440 and 593. It 
seems possible that both allocations and obsezryat ions did not include a 
clear distinction between the operations of addition and subtraction and : 
the application of those skills in problem solving. 

GRADE 5 

At Schools 440 and 333, where achievement on Objective 17, Operations, 
changed very little from time 1 to time 8, the overall rate of materials 
use was much lower than at other schools (Table 22) . At Grade 5, the 
identification of particularly effective instructional patterns is very 
difficult. For example, at School 905 instruction in operations was very 
successful; the achievement gain was more than double the average gain and 
was sufficient to bring tifie time 8 score very close to the average. At. 
School 906, the instructional pattern obseirved was nearly identical to 
that observed at School 905; however, at School 906, the achievement gain ^ 
was -slightly less, than average. -^y,'^^^ 

As at Grade 2, but less dramatically, the use of manipulatives seems^^^ - 
to enhance achievement on Objective 18, Fractions. (Table 23) . T^ 
other apparent effect is of relative emphasis on fractions in the overall 
mathematics curriculum as indicated by proportion of allocated tdine.^>^^:/^; . 

Only at School 593 , was Instruction in Ob j ective 19 / Decimal Fractions 
a major portion of the fifth gratfd mathematics curriculim (T^^ 



Table 22 ^■■y;. ?^--^:,: 
Data SuLnary for Objective 17, Opera tlbns, G^ade 5 : 



Allocated Engaged ■ 



Grouping 



Materlalis Interactions 



.Achievements 



SCHOOL 



, Denog- 
. raphy 



Use of Use of 
DMP IPM 



Est. 
hrs/wk • 



Hrs. 



Hrs; 



r Indlv. ' Soall , Lgv "' Pop. ; Hanlp. Prlnt-^ Stud.^Tchr.; 



IGE/DMP 



■ A40 ■ 


2 


9 . 00 ; 


52.75 


.3.6 


245.1. 


33 


23.22 


63 - 


28.73 


2.'29 :5;84:. 


593 


■;6" ■ 


10.00 


39.00 


2.8 


174.9 


32 


15.66 


90 . 


12.09 


; ; .00 -5.29; 


IGE/non-DMP 




















^^^^4201 


428*^ . 


2 


.00 


71.75 


3.3 


156.7 


32 


24.47" 


79 


I8.54i^ 


333i : 


6 ' 


.00 


58.00 




116.0 . 


23 


12.74 


V , 




; : .00' ; 'iOOj 


non-IGE/DMP 






















905i 


2 


4,00 


17.00; 


3,1 


232.0 


49 


31.94 


79 


31.11 


: 3.58 4:74 : 


906 


' 5 


8.40*. 






314.6 


46 : 


28.65 


'70- 


31.57 :, 


. 6.99:; 2;45 


Mean 




5.11 




3.3 


206.55 36 . 


22.78,. 


76 ■ 


23.25 


" 2.38, 4.92 , 


Standard 
deviation 




4.45 




.28 


71.41 


9.79 


•7.39 


9.24 


8.26 


2.64' 3.76 • 


^Average of scores for DMP use at 5 other DMP schools. 











.00 



j:;;2;^07i;32';^^^^^^ 
^^;io'i4:;.;i:2f;:^|3;iO'^ 



36 .32 ■^■:^i:2i;:^-26:55:. :2 .99 : ; ■:2.63;v -iZ^^^ ^^9^*^^^^^^^^'$ 
:38;B2 2^43^.26.57 ■ 4.46 ' 2^61 : :59 - \7i +a2''^.0]Cj^^^^^^^ 

24.>5 ;i.31 12. .58 .72 +.14 
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Table 23 



Pata Summary for Objective 18, Fractions, Gradr 5 



Allocated 



Engaged 



Grouping 



^Hateclala 



,0 Interactions' 



scHooi: ^ 


Hrs. 


... Z :" 


Hrs. 


X. - 


Indiv, 


IGE/DMP . r 












A40 , 


349.4 


47 


24.68 


58 


24.23 


593 . 


147 .8 : 


27 


20.65 


. 30 


5.02 


IGE/non-Dlff , " 












428 ; 


156.9 


32 • ' 


19.30 


89 , 


7.84 


333 


139.3 


. 27 


3.98 


77 


12.31 


, noQ-IGE/DHP 












' 905 . . . 


170.6 


36 


14.81 


66 " 


. 18.57 


906; 


219 ;5 : 


32 


19.56 


66 


22.11 


Mean 


197.3 


34 


18.16 ■ 


73 


15.01 


.Standard deviation 


79.73 


7.45 


1.10 


11.34 


7.83 



Lg; ; -:,P6p.\ Manlp^' Print .^Stud. 



■Tchr.-V-i;!-!'-';-;:^ 8.:\->':ChV;-;-Resid:,v-: 
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1.27 
.00 

. 70 . 
-.65 

2.72 
3.80' 

1.52 

1.45 



17.30 
20.77 



13.16 

.00 : 

; 1.00 
3.92 

,9.36' 

8.89 



37.50 
2i;25 



18;86 
12,21 

:18.55 
28.95 

22,89 

8.97 



2.74 

; .00;. 

.70 
.00 

- :40; 
.00 

.64 

1.07 



3.84 
12.21 : 



:u.30 

6.29 

15.02 
16 ".69 

10.89 : 

4:97; 



1.80 

^3:04:; 

2.3r: 

■:l-88 

>2.03. 
/ ;69: 



■ 9.-13 .-37,^ '^62: +.25 +.07' V 

■iq:.49'Hjj.;33::^:.;^^ 

3^84' ; .^3 .46^^ [-i-loi^'^^^^^ 

:;V--;37H;.32^\:.. Ay ::'-,Q5:''i^^ 



'1.14 .21 .39 +.18 ; -.01 

}izi67.};.55'l':;:-.71^/^^^^ 

■^;4.6l,',y,-;][4v-^ ^;52;-,^.l8|^^S?f$^S 
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;■, • Table 24 ■ .' ■ . ' ■ 

Data Sunanary for Objective 19, Decimal Fractions,. Grade 5 : 



■-c; 
o 



SCHOOL 


Allocated 


Enga 


ged 




Grouping 






—Materials- ' 


■ '^ Interactiona * 




iUihieveoent 




Hrs. 


X 


Hrs. 


X . 


Indlv. 


Snail 


■ . Lg.' 


Pop. 


Hanlp. 


Print 


■Stud. 


Tchr. 


■ .1 ■ 


/, 8:.f 


•Ch, 


:Reatd;i:' 


IGE/DMP 


































440 


6.7 


1 






























593 


191.5 


35 


15.26 


79 


8.20 


. -. .00 


' 11.25 


12.20 


.00 


.14.37 


.1.66 


■■.5;ll::; 


.27 

:.;-.50' 


.43 


+.16" 

■•.24.:: 


-.00 

,+.12 


IGE/non-DMP 




















: :t ' ■ ■ 














428 
333 


55.4 


11 


11.39 


88 


7.11 


,18 


5,72 


10.76 


•;;;;.4o V ■ 


7,75 


1.97; 


2.64V 


■ ■:39^- 




+;ll'': 




17.8 


3 


3.31 


81 


4.09 


.00 


,oa 


4.09 


■ ■ ,00. ■ 


. ,77 


.■-•,29 A 


■'■■^■•10;''' 


,44 


;>45- 


+,oiv 


^-.12;,■■■;: 


non-IGE/DMP 


































905 
906 


15.0 


3 


1.94 


76 


1.82- 




: .61- 


1.78 


,00 


1.41,, 


■■'>;,iq-:: 


.■V:,5V;^ 




..'.-38-. 


^:+;i2;'V 


■T.osK:^; 


47.6 


7 


4.30 


64 . 


^.36 


.50 [ 


r ,89 


6.41 


■■:V..93;-- 


; 2.63:' 




:;;:;;6d:, 


■■:,2r': 


:.5o 


+.26 


+^;p9'|i 


Mean (5 schools). 


65.5 


12 


' 7.24 


78 


5.32 


.16 


3,69; 


7:,05' 




. 5.39 : 


r/:>96 


1.8 


vV37;-::: 


,51. 






Standard deviation 


72.67 


13.39 


5.78 


8.79 


2.51 


.21 


'4.8O 


4.39 


•.41:': 


5.72 


.''■,83_; 


2.09 


.11- ■ 


.14-. 






Mean (6 schools) 


55.7 


10 
























































.35 


.50 


+..15 . 




Standard deviation 


69.28 


12.76 












'H; ;. 



















.11 ■ -ilS 
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Achievement gains were very large at this- school and at School 906 althougK^^^^^^ 
achievement levels at the two schools were very dlffe^rent* 

At no school wras Instruction in Objective 20, Problem Solving, a ^^^^ 
nif leant portion of the mathematics Instructional program, as shown by 
percentage of allocated time (Table 25). At all schools, achievement 
gains were small from an initial level that was uniformly low. Instriic- ^ 
tional patterns were very similar at the three schools where problem solyirig 
Instruction was observed, ^ := , 














Table 25 . 
Data Siinnnary for Objective 20; Problem Solving 










y 










Allocated 


Engaged 




Gro'iplng 






^Materials 


■ ■ ; 


Interactions \ 




Achlevement8}V. 




SCHOOL 


Hrs. 


X 


/Hrs. 


% 


Indlv. 


Small 




Pop. 


Manip: • 


.Priit;' 


.Stud.. 


. Tchr. . 




8 


Ch. 


Re 


did 


Top/ nun 






































34.1 


5 


4.06 


65 


4.67 


.06 


■1.50 ' 


5.90 


, .00 , 


3.05 




■ . .'^^ 


, .28 


.;39 


.+.11:-' 


■I-" 




;V.593 


0.0 


o' 






















.37 


.41 


+lq4 


'■)-■ 


i 


IGE/non-DMP 




































.428 


26.1 


■ 5 






























i 


333 
























.33. 


'K09V 






28.8 


6 


2.72 


82 


3.30 


.00 


'.00 


3,13 


.00 : 


1.82 ;. 




V;;'.'29 ; 


^ .36 


.41 


:'.-»:.b5-J 






nonriCE/DMP 






N ' 






























:905 


22.3 
























:• .25" :. 








m 


























.30 


+.05 




^906 


20.6 


3 




62 


3.35 


1.16 


.27. 


4.77 


■ 00 ., 


'2i55-i; 


■"■'r.49-' 


; .20 


; .37 


.'47 


■♦^.10 




Kean (3 schools) 


27.8 


5 


3.24 


70 


3.77 


.41 


,.59 


4.60 


.00 . 


2.47- 


.29 




.34 


.42 


+.09 






Standard deviation 


6.80 


1.53 


.72 


10. 


79 .78 


.65 


.80 


1.39. 


.00 


.62 




J-: - .40 


: .05 


.04 






:m 


Mean (6 schools) 


22.0 


k 






















.31 


.39 


+;68 






Standard deviation 


11.79 


2.19 






















.06 


.06 








































. ■■ilJ- 
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:\ . :,Suimnary ■:*■'., \/- y , 

The data presented in this report are . from one of five studies conr-! ; 
ducted as a part of Phase IV of the IGE Evaluatibn Study. The four pri-' • • \ 

mary purposes of the Phase IV Evaluation Project (p. 8) reflect on our 

'■ ■ ' — . ■ • , .' 

' ■■ ■ ' ■ \ -. ■ 

attempt to describe in considerable detail the actual operating character- 
istics of a sample of schools that were using the curriculiim materials 
designed to be compatible with IGE. This ccxnparative study was designed^ V 
to provide information related to the fourth purpose; which was for the 
mathematics program Developing Mathematical Processes (DMP), to contrast, 
two .situations. . V - ■ ' ■ v. • 

— -IGE schools using the program with non-IGE. schools .using the \ 
."■ program ■ ■ :V- ^ ■ .^ ' : ■■.vv^:' ■ [■■'''■''■^''S-^'y--.-^ 

— IGE schools using the program^ with IGE schools using alternate ^ ! 
"programs ' ■ 

The contrast was made on the variables of pupil outcomes/ JjistrU^ 
time, and means of instruction. From this cbritrast^-^^ 



WM'-'- '-' .-- ' ^bi^"" to :answer ^ threei; specif ic questions.-^ •'■''M:''-^:y^^^^ 



1 . What are the effects on mathmatics;;ih^ 
' DMP mathematics rprogram^^ 
\ ment?; 'Vvv^-^^^^^ 



iiS^iV:- : : A' / ; ' : • 2 . 'Vv What';- are : the vef f ects r:bn^mathemat ic 

■environment:?. 



n1;|v:gj:^ 
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3, What are the relationships between the variables presented In the 
Phase IV model? (See Figure 2) 

General Findings - . 

Before we attempt to summarize the findings with respect to the 
specific questions above, an overall picture of mathematics Instruction, 
both at Grade 2 and Grade 5 In this sample of schools. Is warranted* The 
data presented In the previous chapters In some sense describe 14 quite • 
different Instructional settings (eight schools, second grade at all eight 
and fifth grade at six of them). It appears that eachl of the 14 learning 
environments Is unique. The demography of the school, the way in which it 
is organized, the degree of Implementation bf various components of IGE, 
the way in which time is used in classrooms, the way in which instruction 
is actually carried but, and the level of achievement on different objec- 
tives present an i|n teres ting descriptive picture about each learning en- 
vironment. However, there is little common from situation to situation. \ 
For example, using the background variables, we were able to form clusters 
of schools. The first was a pair of schools— both IGE schools, one using : : 
DMP, one not; and a non-IGE school using DMP. Also there were three iso- 
lated cases. This clustering showed moderate relationship dependent upon 

self-report data about implementation of multlaged units; however, it did : 

u 

not include the operational use of the Instructional programming model 
within those units. When we looked at how time was actually allocated 
and spent on various objectives in mathematics and the way in which 
instruction was carried out> the clusters did not demonstrate a consistent \ I 
pattern related to instruction. Thus, the first conclusion of the study " 
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is .that there is no obvious pattern by which the different learning environ- 
ments at each grade level can be appropriately grouped; one cannot confi- 
dently argue that any two classrooms (or units) operated in ^ the same way • 
In spite of this first conclusion, some statements can be made about 
mathematics instruction. At second grade, although there is considerable 
variation in amount of allocated time to different objectives^ it is 
clear that work on the operations of addition and. subtraction comprises 
the largest percentage of allocated time in seven of the eight classrooms. 
The remaining time is distributed somewhat unevenly over the other general 
objectives. Instruction tends to be either carried out at an individual 
leve. or at a large group level. Print materials are predominently used. 
There are relatively few interactions yin all classes, " 

Similarly for Grade 5, thei emphasis is on operations and fractions 

' ' ■ . ■ , \ ^ " ■ 

with little consistent instruction"on~any~other~objectives7~~Instruction~^~ 
is predominently individual. Print materials are most often used, re- * 
gardless of setting or instructional objective. 

At' both grades, if time is reasonably allocated to objectives, then 
students* performafice does Improve, Also, if little time is allocated 
to instruction (such as fractions at second grade) , then little change 
in achievement is shown. 

Specific ■ Findings 

\ . Research Question 1 , What are the effects on mathematics instruction 
of using the DMP mathematics program in an IGE setting and a non-IGE school' 
setting? ^ /: , / 
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Whether a school calls.. itself IGE or not' is not an important variable; 
the label difference is not a good^indicator ' of operating differences in 
the schools. The instructional progranming^odel is the key here. It is 
what good teachers follow anyway. This study ^s not a good test of use of 

the instructional prograiiiming model. 1 • 

■ ' ' • • ' ■ ^^^^^ \ '[ ' . . 

Rese arch Question 2. What are the effects on mathematics "^instruction 

. , , 

of using DMP and using other mathematics programs in the IGE school en- 

• ■ ■ ■ • , '■' \ _ . ■ 

vironment? ■ '/'■:\.-. 

At Grade 2, the non-DMP uders did not allocate time to solving word 
problems. This objective is emphasized in DMP. The; differences in problem- 
solving performance between %DMP and non-DMP groups clearly favors the use 
of DMP. Similar differences at Grade 5 were- not found since little time 
was allocated to problem solving in any class. A second unanticipated 
finding was that there was no pattern of differences favoring the non-DMP 
users on the operations of addition and subtraction. Since DMP does not : 
emphasize mastery of addition and subtraction until the beginning of third 
grade, the activities at Grade 2 are designed to develop the conceptual * 
underlying ideas for those skills. Thus, the amount of allocated time 
for addition and subtraction should have been less at DMP schools, and 
perfotmance, in turn, should have been lower. Neither was the case. DMP 
users seem to have modified the program so that the time allocated to 
computation .was_simllar_to Xhat„allocatedi:by: nonrDMP users. For all -^0 
^schools, we believe an inordinant amount of time is spent on addition and J 
subtraction skills, at Grade 2, with not enbugh time allocaited to other 
important parts of . mathematics. Thus, our second conclusion is that the . 



differences between DMP users and DMP non-users are not as striking as 
expected. In this study, we are not In the position to examine how and 
why teachers modified the program to fit the traditional pattern of in- 
struction; this seems to be the pattern which has emerged at both second 
and fifth grade. 

Research Question 3 , What are the relationships between the variables 
presented in the model for the evaluation? ' ' ' 

The overall realtionship as proposed ,in the model cannot be statis- 
tically examined in the study.. Many of the variables are highly correlated 
and the sample of schools is very small. It was hoped that an overall 
pattern could be seen with reispect to the variables; this is not the case. 
^However, there are some hints of- relationships that warrant attention in . 
later studies. 

First, a ^ov^er ^^lljnlt for allocated time is needed to increase achieve- 
ment in any areas, but tfie-^relationship of allocated time to performance 
is not linear. For example, at ^rade 2 the variability in ti^ 
to computation is not related to achlevement^slii^e^all spend a ^^^^^^ 
time. In fact, some schools are probably spending t^6t)-.much time for the 
relative pay off. 

Second, individualized instruction with children working independent!^^ 
on worksheets is detrimental. For example, in School 333 at Grade 5, -v^^^^^^^^^ v^^^^ 
where this is the only way^^ln which instruction is carried out, the • 
approach produces low achievement. ' 

Third , for some ofv^^the objectives (fractions^ place value, and n 
I, for example) ir-.the use of manipulative materials as a, means of in- ii^f^vIS 



tlon, 

structlon vis very effective for Improving achlevementv^^^^^ 



... ... . _ . i; v^.., v.. .->-r ^ 
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Fourth, interactions of children with other children or with teachers 
are needed. Again, in Grade 5 at School 333, there are almost no inter- 
actions and the children's performance is disappointing* 

Limitations 

Before concluding this chapter, let me remind the reader of three 
basic limitations of this s^tudy. First, these data come from a small 
sample of schools. No claim can be made that they are representative 
either of DMP users or of IGE schools . Second, the variables examined in . 
this study are the variables of interest in the IGE model. The data asso-* 
ciated with these variables are highly correlated. For example, allocated, 
time is highly correlated with engaged time. Analysis on small sets of ■ 
related data could not be done with meaning and has not been attempted; 
the relationships discussed above must be considered suspect. Third, 
there are four different sets of data on these classrooms. The background 
data were provided by teachers and administrators from self-report ques- 
tionnaires; these data provide information about school-wide patterns . 
The class log data was provided by teachers on how time was spent for one 
group of children in their classrooms. Observations in those classrooms ^ 
were often on differiant sets of' students as regrouping took place. Finally, 
the achievement data came from all students; it provides Information about 
that total population. These two data sets provide different est imates^^^-;^^ > 
of class variables. The appropriateness of the sources for predicting what, 
the group is like has not been demonstrated. 1 



Conclusions 
— ^ ■ II ■ ■ ■ ■ ■ ■ 

' ' "' . 

■ ■ 

On reflection^ It Is now clear that selecting schools because they 
call themselves "IGE schools" or "DMP users" is not adequate for testing 
either the use of the instructional progrannnlrig models the key feature of 
IGE, or the use of the particular Instructional materials. Developing 
Mathematical Processes. For both, a school's use of the label is no 
guarantee that the ideas associated with either the instractional program- 
ming model or DMP are being followed. In fact, what seems to ^be the case 
is that the underlying conceptual ideas which guided the developers of 
IGE or DMP are not clearly reflected in the way in which instruction is 
' carried out. This conclusion may be an artifact of the sample chosen or ' 
it may be more , pervasive. In fact, it may be unreasonable to expect 
people to change as much as was expected in an IGE /DMP setting. For^ 
example, the teacher using DMP materials without using the mariipulatives 
or small groups and passing out only worksheets is hardly using the 
program. Or, an IGE school in which teachers do not regroup students 
periodically according to need does not provide a good test of the in- ^ 
structional programming model. 

It should be apparent that vze have not reported all of the; data / 
gathered in this study. It would have been better to gather less data 
from more sctiools. What we have . is an extensive djBscription of 14 dif- v 
f erent learning environments, not one of which reflects in a clear way • : 
the ideas underlying IGE or DMP. In fact, the strongest claim that can ; ^.i 
be made is that each class has its own characteristics* This diversity 
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,j is not a function of the type, of community, of the way in which instruc- 
^- tion is carried out, of whether a school calls itself IGE, or whether theyN 
use a particular mathematics' program, 

,v What can be said in conclusion is that one needs to .spend a mlnimuin 

■ > ■ ■ , ' ''''' : ' \ ' " ■ 

V amount of tlm^ on an objective to produce achievement; there needs to be 
some teacher/pupil interaction; instruction best proceeds from the con- 
crete to the abstract; and time .should be allocated to solving word 
problems. 
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